An exception is an event that occurs during the execution of a program that disrupts the normal flow of instructions.Java programming language provides exceptions to deal with errors and other exceptional events in the code. The biggest advantage of exceptions is that they simply allow you to separate error-handling code from regular code. This improves the robustness and readability of programs created in Java.
Java provides several techniques to effectively work with exceptions: – try, catch, and finally − to handle exceptions, – try-with-resources statement − to work with resources, – throw/throws − to throw and declare exceptions respectively.
In JUnit, we may employ many techniques for testing exceptions including: – "Old school"try-catch idiom – @Test annotation with expected element – JUnit ExpectedException rule – Lambda expressions (Java 8+)
Continue reading to find out which technique is best for you.
Code to be tested
Throughout the article different examples will be presented. The below class will be used in most of them. It provides simple methods throwing exceptions, either checked or unchecked:
Thrower − containing several methods that throw some exceptions
All examples can be found in my GitHub repository.
A bit of history
In JUnit 3 and in JUnit 4 − before ExpectedException rule was introduced − the best way to test exceptions was by using standard classical try-catch idiom in a unit test:
Assert.fail("Expected exception to be thrown");
.hasMessage("My custom runtime exception");
The above test will fail when no exception is thrown and the exception itself is verified in a catch clause. This solution is perfectly fine, but it has some drawbacks. Firstly, extra code needs to be created; we always need to remember to fail the test if no exception is thrown (otherwise nothing happens and the test will pass). And finally, if other than expected exception is thrown the test will fail but not with the assertion error as we would expect. For example, the following test:
thrower.throwsRuntime();// assume this is an unexpected exception
thrownewRuntimeException();// never executed!
This approach to testing exceptions in JUnit code is a really simple, built-in, not much code but… We need to be quite careful about using @Test annotation: there is way to verify the message or the cause which may lead to quite unexpected behaviour like in the misleading method in the above example.
But fortunately there is a better solution!
Introducing ExpectedException rule
In JUnit, rules (@Rule) can be used as an alternative or an addition to fixture setup and cleanup methods: @Before, @After, @BeforeClass, and @AfterClass. ExpectedException rule is meant for verification that code throws a specific exception. The rule must be declared as public field annotated with @Rule annotation:
To properly use a ExpectedException rule we need to add expectations to it before execution of the test method. Note that adding a rule does not affect tests that are not using it which means you may have tests that use rule and ones that don’t. In addition, the rule may be reused − we don’t need to create separate rules for different tests.
In the below example, we verify the type and message of an exception.
If the expected exception is not thrown a valid assertion error will be thrown by JUnit with a descriptive message:
Expected:(an instance ofc.g.k.e.MyRuntimeException andexception with messageastringcontaining"My custom runtime exceptions")
but:exception with messageastringcontaining"Something else"message was"My custom runtime exception"
As you may see, the code is much more readable. We are also sure that if other type of exception is thrown the rule will record that and inform us the same way. So the previous example will look much simpler now:
thrown.reportMissingExceptionWithMessage("No exception of %s thrown");
the message will be:
java.lang.AssertionError:No exception of type an instance ofc.g.k.e.MyRuntimeException thrown
What can I do more with ExpectedException?
What is more,the ExpectedException rule provide us methods to verify exceptions in a more sophisticated way using Hamcrest matchers. Hamcrestprovides a library of matcher objects and it works great with JUnit. If you work with Maven or Gradle JUnit depends on Hamcrest so Hamcest will be in the classpath.
Verify the message with either built-in Hamcrest matcher
I usually used built-in matchers as they provide most of the basic and more advanced matchers. Custom matchers can be used for some special cases like for example verifying more complex exception objects with come custom fields etc.
AssertJ − Fluent assertions for Java − provides a rich set of assertions with helpful error messages. With AssertJ (3+) and Java 8 testing exceptions is much easier than before. The idea is to pass a Java 8 @FunctionalInterface whose instances can be created with lambda expressions, method references, or constructor references to an assertion method that will capture the exception and return an assertion object. Let’s see an example:
In my opinion testing exceptions with AssertJ and Java 8 is one of the cleanest solutions so far. It is really easy to write and read. Comparing to ExpectedException rule it does not require to define any public field that may not be used in many tests in the class. In addition, the standard assertions offered by the library are enough for many cases. And if not, you can easily create custom ones.
There is no single and best way to test exceptions in JUnit. The technique chosen depends on the code to be tested. For basic cases standard @Test annotation may be utilized. For more complex scenarios,ExpectedException can be employed as it is also very simple but much more powerful than @Testannotation. Built-in or custom Hamcrest matchers offer some possibilities for creating better tests.
As of Java 8, I am in favour of AssertJ’s way of testing exceptions. I find it really clear (e.g. I don’t need to introduce an additional public field that may be used or not), easy to write (in most cases one liners) and really powerful (great built-in matchers plus extensible with easy to write custome ones).
Since in all my tests I employ AssertJ I don’t see any reason for not using it for testing exceptions in JUnit.
And how do you test exceptions in your Java / JUnit code?