A simple and effective way to create feature-rich and type-safe Scala command line apps.
An example speaks more than a thousand words:
import io.jobial.sclap.CommandLineApp
import scala.concurrent.duration._
import cats.effect.IO
object PingExample extends CommandLineApp {
def run =
for {
host <- param[String].label("<hostname>").description("The host").required
count <- opt[Int]("count").description("Number of packets")
timeout <- opt[Duration]("timeout").default(5.seconds).description("The timeout")
} yield
IO(println(s"Pinging $host with count: $count, timeout: $timeout..."))
}
which produces the following usage message when run with --help on a colour terminal:
If you run it without any arguments, you will get the following on the standard error along with a non-zero exit code, as expected:
> PingExample
Missing required parameter: '<hostname>'
Usage: PingExample [-h] [--count=PARAM] [--timeout=PARAM] <hostname>
<hostname> The hostname.
--count=PARAM Number of packets.
-h, --help Show this help message and exit.
--timeout=PARAM The timeout (default: 5 seconds).
If you run it with the argument "localhost", you should get:
> PingExample localhost
Pinging localhost with count: None, timeout: 5 seconds...
Finally, if you specify some options, you will see something like:
> PingExample --count=2 localhost
Pinging localhost with count: Some(2), timeout: 5 seconds...
Try me on Scastie with Scala 3.1.
These examples assume that you have created an alias to your Scala app or wrapped it up in a script so that
you can execute it on the command line as PingExample
.
A few things to note here:
-
Type safety: Sclap correctly infers the type of each command line option and parameter. For example,
count
is anOption[Int]
because it is not required to be specified by the caller. Host, on the other hand, is aString
(not anOption[String]
) because it is required. The same way, timeout is aDuration
because it has a default value, so it is always available. By being type safe, there is virtually no possibility of ending up with options and parameters in an invalid state. You can be sure your opts and params are always valid and available in your application logic, otherwise Sclap will catch the problem before it reaches your code and handles the error appropriately (for example, it returns an error exit code and prints the error and usage messages). -
Custom type support: Sclap has built-in support for common argument value types (
String
,Int
,Double
,Duration
, ...). You can easily add support for further types (or override the defaults) by implementing instances of theArgumentValueParser
andArgumentValuePrinter
type classes (see examples later). -
The app extends the
CommandLineApp
trait and has to implement therun
function. The result of this function is of typeCommandLine[_]
. You don't really need to know much about it though: as long as you implement yourrun
function in this format, it will return the right type and Sclap will be able to interpret your CLI. -
In the yield part of the for {...}, you can return pretty much anything, Sclap will know how to deal with it, including error handling. You might have noticed though that the return type of the yield block is actually always an
IO[_]
. If you are not familiar with the IO monad, all you need to know about it is that your application logic has to be enclosed in an IO ('lifted' into an IO context) before it is returned in the yield part of the for comprehension in the run function. If your application logic results in something other than an IO, it gets implicitly 'lifted' into anIO[_]
context. For example, if yield has code that returns an Int, it will implicitly becomeIO[Int]
, taking care of any exceptions potentially thrown in the process. Also, if yield results in aFuture
,Try
or anEither[Throwable, _]
, Sclap will know how to lift them into anIO[_]
context in a safe (referentially transparent) way, propagating and handling errors automatically. The IO context guarantees that your application logic will only run once the arguments have been parsed and validated safely. -
Sclap will handle errors returned by your application code automatically: if your app throws an exception (or returns an error state in an
IO
,ZIO
,Future
orTry
), it will automatically be turned into a non-zero exit code. Alternatively, you can return anIO[ExitCode]
to explicitly specify the exit code (seecats.effect.ExitCode
in Cats Effect).
Sclap is a purely functional, type safe, composable, easy to test command line argument parser for Scala. Command line is still king and writing command line tools should be straightforward and painless.
Although Sclap is built on Cats, Cats Effect and Cats Free in a purely functional style and combines best with the Cats ecosystem, you don't need to know any of those libraries to use it. Sclap can be seamlessly used in non-Cats based or non-FP applications as well. It comes with:
- Automatic, fully customizable usage help generation
- Type safe access to command line options and parameters in your application code
- Support for custom type arguments
- ANSI colours
- Bash and ZSH autocomplete script generation
- Subcommand support, with support for composable, nested, hierarchic interfaces
- Straightforward, composable, purely functional, referentially transparent CLI description
- Extendable API and implementation, with parser implementation decoupled from DSL
- Flag, single-value and multiple value options
- POSIX-style short option names (-a) with grouping (-abc)
- GNU-style long option names (--opt, --opt=val)
The motivation is to help promote Scala as an alternative to implementing command line tools as scripts and to make it easier to expose existing functionality on the command line. Writing CLI tools should be a very simple exercise and Scala today is a better language for the task than most others (including scripting languages). Sclap aims to provide a well maintained and stable library that is feature rich enough to cover all the modern requirements.
import io.jobial.sclap.CommandLineApp
import cats.effect.IO
object HelloExample extends CommandLineApp {
def run =
for {
hello <- opt[String]("hello")
} yield
IO(println(s"hello $hello"))
}
which produces the following usage help:
> HelloExample --help
Usage: HelloExample [-h] [--hello=PARAM]
-h, --help Show this help message and exit.
--hello=PARAM
or
> HelloExample --hello=world
hello Some(world)
You can find this example along with many other more complex ones here.
To use Sclap you need to add
libraryDependencies ++= Seq(
"io.jobial" %% "sclap" % "2.0.0"
)
to your build.sbt
or
<dependency>
<groupId>io.jobial</groupId>
<artifactId>sclap_${scala.version}</artifactId>
<version>2.0.0</version>
</dependency>
to pom.xml
if you use Maven, where scala.version is either 2.12 or 2.13. For Scala 2.11, use 1.4.0.
...
which produces the usage:
...
import io.jobial.sclap.CommandLineApp
import cats.effect.IO
object HelloWorldExample extends CommandLineApp {
def run =
command.header("Hello World")
.description("A hello world app with one option.") {
for {
hello <- opt[String]("hello").default("world")
} yield
IO(println(s"hello $hello"))
}
}
which produces the usage help:
> HelloWorldExample --help
Hello World
Usage: HelloWorldExample [-h] [--hello=PARAM]
A hello world app with one option.
-h, --help Show this help message and exit.
--hello=PARAM (default: world).
Sclap supports subcommands naturally by nesting command specs. Let's say we want to define a command line interface to add or subtract two numbers:
import io.jobial.sclap.CommandLineApp
import cats.effect.IO
object ArithmeticExample extends CommandLineApp {
def add =
for {
a <- param[Int].required
b <- param[Int].required
} yield IO(a + b)
def sub =
for {
a <- param[Int].required
b <- param[Int].required
} yield IO(a - b)
def run =
for {
addResult <- subcommand("add")(add)
subResult <- subcommand("sub")(sub)
} yield for {
r <- addResult orElse subResult
} yield IO(println(r))
}
> ArithmeticExample --help
Usage: ArithmeticExample [-h] [COMMAND]
-h, --help Show this help message and exit.
Commands:
add
sub
and
> ArithmeticExample add --help
Usage: ArithmeticExample add PARAM PARAM
PARAM
PARAM
so we can
> ArithmeticExample add 3 2
5
> ArithmeticExample sub 3 2
1
The structure of a subcommand is the same as of a main command. Commands can be arbitrarily combined into a hierarchy of
subcommands using the subcommand(...)
function. Since everything is referentially transparent here, subcommand and
command definitions can be reused and combined arbitrarily, without any side-effect.
This can be demonstrated by improving on the arithmetic example the following way. Let's say we want to implement division and multiplication in addition to the previous operations. Since all these require two operands and only differ in the operator, it would be redundant to implement them as separate functions. Instead, the code for the subcommands can be shared the following way, for example:
def operation[T: ArgumentValueParser](name: String, op: (T, T) => T) =
subcommand[T](name) {
for {
a <- param[T].required
b <- param[T].required
} yield IO(op(a, b))
}
def run =
for {
subcommandResult <- subcommands(
operation[Double]("add", _ + _),
operation[Double]("sub", _ - _),
operation[Double]("mul", _ * _),
operation[Double]("div", _ / _)
)
} yield subcommandResult.map(println)
As can be seen from this example, the code for the subcommands has been completely generified: both the operand type and
the operators are parameters here. Since the type is a parameter now, we need to make sure there is
an ArgumentValueParser
instance available for it to be able to use it in param[...]
. Another thing to note is that
Sclap provides a useful alternative to orElse
when it comes to combining the results of the subcommands.
The subcommands(...)
function takes a variable number of subcommand definitions as arguments, and returns the result
of the one selected by the caller (just like as if orElse
was used between the individual subcommand results). This is
useful because the selection of the subcommand result can be moved to the main for comprehension, without introducing
another one in the yield section (see previous example).
We can now:
> ArithmeticExample mul 3 2
6
> ArithmeticExample div 3 2
1.5
To further improve our arithmetic app, we can add headers and description to the main command and the subcommands like this:
def operation[T: ArgumentValueParser](name: String, op: (T, T) => T) =
subcommand[T](name)
.header(s"${name.capitalize} two numbers.")
.description("Speficy the two operands and the result will be printed.") {
for {
a <- param[T].description("The first operand.").required
b <- param[T].description("The second operand.").required
} yield IO(op(a, b))
}
def run =
command("arithmetic")
.header("Simple arithmetics on the command line.")
.description("Use the following commands to add, subtract, multiply, divide numbers.") {
for {
subcommandResult <- subcommands(
operation[Double]("add", _ + _),
operation[Double]("sub", _ - _),
operation[Double]("mul", _ * _),
operation[Double]("div", _ / _)
)
} yield subcommandResult.map(println)
}
As explained before, your run
function (either explicitly or implicitly) always takes this format:
import cats.effect.IO
def run =
for {
_ <- opt(...)
} yield IO {
// app code
}
If the IO results in an error state, the default error handling is to print the error message and return a non-zero exit code:
import cats.effect.IO
import io.jobial.sclap.CommandLineApp
object ErrorExample extends CommandLineApp {
def run =
for {
hello <- opt[String]("hello").default("world")
} yield
IO.raiseError(new RuntimeException("an error occurred..."))
}
> ErrorExample
an error occurred...
Since the application code in yield is always wrapped in an IO, an exception will result in an IO with an error state exactly the same way as above:
import io.jobial.sclap.CommandLineApp
import cats.effect.IO
object ExceptionExample extends CommandLineApp {
def run =
for {
hello <- opt[String]("hello").default("world")
} yield IO {
throw new RuntimeException("an error occurred...")
}
}
should execute like
> ExceptionExample
an error occurred...
with a non-zero exit code. However, if you call it with --help, the application code will never run and the exception doesn't get thrown, as you would expect:
> ExceptionExample --help
Usage: ErrorExample [-h] [--hello=PARAM]
-h, --help Show this help message and exit.
--hello=PARAM
Sclap can be used seamlessly with ZIO through ZIO's cats-interop. Sclap also provides the more convenient
ZIOCommandLineApp
base trait:
libraryDependencies ++= Seq(
"io.jobial" %% "sclap-zio" % "1.2.1"
)
and then
import io.jobial.sclap.zio.ZIOCommandLineApp
import zio.console._
object ZIOExample extends ZIOCommandLineApp {
def run =
for {
hello <- opt[String]("hello")
} yield putStr(s"Hello $hello")
}
You can return a Future seamlessly in the yield part of the run function:
import concurrent.Future
def run =
for {
hello <- opt[String]("hello").default("world")
} yield Future {
println(s"hello $hello")
}
It should produce:
> HelloExample
hello world
Of course, the Future
gets executed only if Sclap could parse the arguments successfully and help is not requested.
Errors are handled as expected:
import concurrent.Future
def run =
for {
hello <- opt[String]("hello").default("world")
} yield Future {
throw new RuntimeException("there was an error...")
}
should run like
> HelloExample
there was an error...
with a non-zero exit code.
You can return a Try or an Either as well:
import util.Try
def run =
for {
hello <- opt[String]("hello").default("world")
} yield Try {
println(s"hello $hello")
}
import util.Either
def run =
for {
hello <- opt[String]("hello")
} yield hello match {
case Some(hello) =>
Right(hello)
case None =>
Left(new IllegalArgumentException("wrong argument"))
}
The behaviour is the same as for Future.
Argument values are handled type safely in Sclap. Parsing and printing arguments of different types are done through
the ArgumentValueParser
and ArgumentValuePrinter
type classes.
An example for parsing a command line option of type LocalDate:
import io.jobial.sclap.CommandLineApp
import io.jobial.sclap.core.{ArgumentValueParser, ArgumentValuePrinter}
import java.time.LocalDate
import scala.util.Try
import cats.effect.IO
object DateExample extends CommandLineApp {
implicit val parser = new ArgumentValueParser[LocalDate] {
def parse(value: String) =
Try(LocalDate.parse(value)).toEither
def empty: LocalDate =
LocalDate.now
}
implicit val printer = new ArgumentValuePrinter[LocalDate] {
def print(value: LocalDate) =
value.toString
}
def run =
for {
d <- opt[LocalDate]("date").default(LocalDate.now).description("The date")
} yield
IO(println(s"date: $d"))
}
Instead of defining the printer directly, it can be derived from a Show
intance. So the following would also work as a way to
derive the argument value printer for LocalDate, for example:
implicit val localDateShow = Show.fromToString[LocalDate]
If for some reason you need to access all the arguments as they were passed on the command line, you can use the args function:
def run =
for {
a <- args
} yield
IO(println(a)) // a is a Seq[String] with all the arguments
The name of the app printed in the usage help is derived from the main class name by default. It can be overridden by using either the syntax
def run =
command(name = "my-app").description("My really cool app.") {
for {
o <- opt(...)
} yield
...
}
or by setting the app.name
system property:
java -Dapp.name=my-app ...
...
Sclap comes with the CommandLineAppTestHelper
trait to help you write tests against your CLI specs:
You can find more examples here.
A few pointers on the structure of the command line description in Sclap. An application typically implements
the CommandLineApp
trait, which provides a safe implementation of the main
function relying on Cats Effect's IOApp
.
The app has to implement the
def run: CommandLine[Any]
function, which expands to
def run: CommandLineArgSpec[IO[Any]]
which in turn is the same as
def run: Free[CommandLineArgSpecA, IO[Any]]
The typical structure of a run
function is
def run =
for {
o <- opt(...)
...
} yield IO {
...
}
which is just a monadic expression using the CommandLineArgSpec
Free monad from above. The for part of the
comprehension binds the option and parameter values to names, and the yield section returns the application logic. As
mentioned before, the return type of the yield part is always IO[_]
. This is important: IO
is pure and allows the
library to process the description safely, without any side-effects. To make it more convenient for applications that do
not use Cats Effect, Sclap provides safe implicits to lift other common return types (Future
, Try
or Either
) into
an IO context in a referentially transparent way (of course, the rest of your code will not become referentially
transparent).
No macros used or animals harmed in the making of Sclap.
Sclap is modular and comes with the following artifacts:
- sclap-core: defines the DSL, built on cats-free and cats-effect; the DSL is implementation independent, leaving it
open for alternative parser implementations and making it future proof in case the default parser impl (which
currently uses Picocli) becomes obsolete or unmaintained. An implementor has to implement the
executeCommandLine
function which takes theCommandLine
description along with the command line args as arguments. - sclap-app: provides the
CommandLineApp
trait and other helper functionality. - sclap-picocli: the default Sclap parser implementation built on Picocli, which is a mature command line parsing library with a traditional, non-safe Java API. Fortunately it comes with no dependencies apart from the Java standard library and exposes a fairly reusable API.
- sclap-zio: ZIO support.
- sclap-examples: Example apps.
Sclap relies on the Free monad class from cats-free to implement the DSL that describes the command line interface. The DSL is used in two phases: the first pass builds the command line interface structure, which is then used in a second pass to parse the actual arguments passed to the app and bind the results to the values in the monadic expression, or to generate the command line usage text in case of a failure or if --help is requested. The application logic is represented as an IO monad, which comes from cats-effect. By describing the application logic in a referentially transparent manner, it is possible to evaluate the command line description multiple times without any side effects ( like running actual application logic, for example).
Sclap relies on a few carefully designed implicits to make the syntax more concise. If you want to override the defaults
or have an aversion to implicits, you can always choose to not include the built-in implicits in your code by extending the
CommandLineAppNoImplicits
trait instead and cherry-pick the ones you need separately. If you decide not to use
any of the implicits provided by the library, the syntax becomes slightly more verbose but still manageable. Here is an
example:
...
If you need to access the implementation specific features in Picocli for whatever reason, the sclap-picocli module provides extensions to Opts and Params that allow access to the underlying Builder instances directly, for example:
opt(...).withPicocliBuilder(_.hidden(true))