We Need A Better Testing Framework (2019)

WE NEED A BETTER
TESTING FRAMEWORK
NOAM TENNE

$ WHOAMI
HACKING AROUND FOR THE PAST ~15 YEARS
VANMOOF
@NOAMTENNE
GITHUB.COM/NOAMT
MEDIUM.COM/@NOAMT
BestCompany
Ever!!1

$ FIND . -NAME | GREP TDD
DO YOU TDD?

DO YOU BDD?
$ FIND . -NAME | GREP BDD

$ WHICH BDD
SCENARIO: DESCRIPTION
GIVEN: A STATE
WHEN: AN ACTION IS PERFORMED
EXPECT: AN OUTCOME

$ VIM BEHAVE.FEATURE
Feature: This is behave
Scenario: Run something
Given we use behave
When we write specs
Then behave runs them

$ VIM STEPS/BEHAVE_STEPS.PY
from behave import given, when, then, step
@given('we use behave')
def step_impl(context):
pass
@when('we write specs')
assert True != False
@then('behave runs them')
assert context.failed is False

from nimoy.specification import Specification
class ExampleSpec(Specification):
def example_feature(self):
with given:
pass
with expect:
pass
$ VIM NIMOY_SPEC.PY End with _spec.py
Extend
Specification
Contain steps
using “with”

$ VIM NIMOY_SPEC.PY
with setup:
pass
with expect:
pass

with setup:
pass
with when:
pass
with then:
pass
$ VIM NIMOY_SAR_SPEC.PY

$ VIM NIMOY_SAR_SPEC.PY
Look, mom!
No asserts!
with setup:
a = 5
with when:
a = a + 1
with then:
a == 6

$ FIND . -NAME | GREP DDT
DO YOU DDT?

$ WHICH DDT
SCENARIO: DESCRIPTION
GIVEN: A STATE
WHEN: AN ACTION IS PERFORMED
EXPECT: AN OUTCOME
WHERE: VARIABLES EQUAL VALUES

$ VIM TEST_PYTEST_PARAMS.PY
import pytest
@pytest.mark.parametrize("script,result", [
("2 * 21", 42),
("int(0.1337 * 10000)", 1337),
])
def test_eval(script, result):
assert eval(script) == result

def example_feature(self, value_a, value_b):
with given:
a = value_a
b = value_b
with expect:
(a * b % 2) == 0
with where:
value_a | value_b
2 | 5
2 | 21
$ VIM NIMOY_MATRIX_SPEC.PY
Declare
variables
Variables
Provided

with given:
a = value_of_a
b = value_of_b
with expect:
(a * b % 2) == 0
with where:
value_of_a | value_of_b
2 | 5
2 | 21
$ VIM NIMOY_MATRIX_SPEC.PY
Declare
variables
Inject
anywhere

$ VIM NIMOY_LIST_SPEC.PY
with given:
a = value_of_a
b = value_of_b
with expect:
(a * b % 2) == 0
with where:
value_of_a = [2, 2]
value_of_b = [5, 21]

$ FIND . -NAME | GREP MOCK
DO YOU
MOCK?

$ VIM UNITTEST_MOCKS.PY
from unittest import mock
from mock import Mock
def test_mocks():
teh_mock = Mock()
teh_mock.do_it()
assert teh_mock.do_it.call_count == 1
teh_mock.do_another.return_value = 5
assert teh_mock.do_another() == 5

from unittest.mock import Mock
with given:
a = Mock()
with when:
a.method_call() >> 5
with then:
a.method_call() == 5
$ VIM NIMOY_MOCK_STAGING_RETURN_VALUE.PY
Constant
return value

with given:
a = Mock()
with when:
a.method_call() << [5, 6, 7]
with then:
$ VIM NIMOY_MOCK_STAGING_SIDE_EFFECT.PY
Side effect

with given:
a = Mock()
with when:
a.method_call('argument')
with then:
1 * a.method_call('argument')
$ VIM NIMOY_MOCK_SPEC.PY
No. Of
invocations
Target mock
Expected
arguments

Any no. of
invocations
with given:
a = Mock()
with when:
with then:
_ * a.method_call('argument')

with given:
a = Mock()
with when:
with then:
_ * a.method_call(_)
Any arg
value

$ FIND . -NAME | GREP SUGAR
JUST
SHOWING OFF

$ VIM EXPECTING_EXCEPTIONS.PY
class MySpec(Specification):
def my_feature_method(self):
with given:
# Setup
with when:
raise Exception('Whaaaaat')
with then:
err = thrown(Exception)
str(err[1]) == 'Whaaaaat'

$ VIM REGEX.PY
class MySpec(Specification):
def regex_assertion(self):
with given:
exp = 'The quick brown fox'
with expect:
exp @ '.+brown.+'
This is a valid regex evaluation

$ WHICH NIMOY
PYTHON 3
UNITTEST
AST

github.com/browncoat-ninjas/nimoy
Version: 0.0.1b7
Search Medium for “Building Nimoy”

We Need A Better Testing Framework (2019)

More Related Content

Similar to We Need A Better Testing Framework (2019) (6)

More from noamt (6)

Recently uploaded (20)

We Need A Better Testing Framework (2019)