Mailspring/build/tasks/run-unit-tests-task.coffee
Evan Morikawa c3ecca2692 feat(tests): add integration tests
comment

Adding test harness

Using key strokes in main window test

Tests work now

Clean up argument variables

Rename list manager and get rid of old spec-helper methods

Extract out time overrides from spec-helper

Spectron test for contenteditable

fix spec exit codes and boot mode

fix(spec): cleanup N1.sh and make specs fail with exit code 1

Revert tests and get it working in window

Move to spec_integration and add window load tester

Specs pass. Console logs still in

Remove console logs

Extract N1 Launcher ready method

Make integrated unit test runner

feat(tests): adding integration tests

Summary:
The /spectron folder got moved to /spec_integration

There are now unit tests (the old ones) run via the renamed
`script/grunt run-unit-tests`

There are now integration tests run via the command `script/grunt
run-integration-tests`.

There are two types of integration tests:
1. Tests that operate on the whole app via Selenium/Chromedriver. These
tests have access to Spectron APIs but do NOT have access to any JS object
running inside the application. See the `app-boot-spec.es6` for an example
of these tests. This is tricky because we want to test the Main window,
but Spectron may latch onto any other of our loading windows. Code in
`integration-helper` give us an API that finds and loads the main window
so we can test it

2. Tests that run in the unit test suite that need Spectron to perform
integration-like behavior. These are the contentedtiable specs. The
Spectron server is accessed from the app and can be used to trigger
actions on the running app, from the app. These tests use the
windowed-test runner so Spectron can identify whether the tests have
completed, passed, or failed. Unfortunately Spectron can't access the logs
, nor the exit code of the test script thereby forcing us to parse the
HTML DOM. (Note this is still a WIP)

I also revamped the `N1.sh` file when getting the launch arguments to work
properly. It's much cleaner. We didn't need most of the data.

Test Plan: new tests

Reviewers: juan, bengotow

Differential Revision: https://phab.nylas.com/D2289

Fix composer specs

Tests can properly detect when Spectron is in the environment

Report plain text output in specs

fixing contenteditable specs

Testing slow keymaps on contenteditable specs

Move to DOm mutation

Spell as `subtree` not `subTree`
2015-12-02 13:41:14 -08:00

25 lines
868 B
CoffeeScript

childProcess = require 'child_process'
module.exports = (grunt) ->
{notifyAPI} = require('./task-helpers')(grunt)
desc = "Boots N1 in --test mode to run unit tests"
grunt.registerTask 'run-unit-tests', desc, ->
done = @async()
testProc = childProcess.spawn("./N1.sh", ["--test"])
testOutput = ""
testProc.stdout.pipe(process.stdout)
testProc.stderr.pipe(process.stderr)
testProc.stdout.on 'data', (data) -> testOutput += data.toString()
testProc.stderr.on 'data', (data) -> testOutput += data.toString()
testProc.on 'error', (err) -> grunt.log.error("Process error: #{err}")
testProc.on 'exit', (exitCode, signal) ->
if exitCode is 0 then done()
else
testOutput = grunt.log.uncolor(testOutput)
msg = "Aghhh somebody broke the build. ```#{testOutput}```"
notifyAPI msg, -> done(false)