72 commits

Author	SHA1	Message	Date
Jackie Luo	a00f86660c	Create file objects from MIME parts	2016-06-28 11:32:18 -07:00
Ben Gotow	f68948c23f	Fix population of db fields in processor	2016-06-27 16:38:40 -07:00
Ben Gotow	91887a6e11	Speed up sync by fetching preferred body block only	2016-06-27 16:11:36 -07:00
Juan Tejada	ed749e0f51	Add sync worker error handling ... - Handles sync errors in a single place. For now, if error is not a socket error, will treat as a permanent error, save the error to the account object, and prevent any other syncing until the error is cleared from the account object - Adds a NylasError class that can be extended and serialized. Adds it to global namespace on all packages and replaces all uses of regular Error	2016-06-27 16:03:38 -07:00
Jackie Luo	179f24449b	Refactor code and add test for threading	2016-06-27 14:52:05 -07:00
Ben Gotow	76d873c2b2	Reintroduce concept of provider, start work on Gmail	2016-06-27 10:43:53 -07:00
Juan Tejada	1fe7fdf4b1	More sync error handling WIP	2016-06-27 10:27:38 -07:00
Juan Tejada	63b929e59b	Fix missing promise based error handling in sync-worker	2016-06-26 09:52:03 -07:00
Juan Tejada	dd350a5081	Update IMAPConnection api + error handling fixes + misc ... - `IMAPConnection::openBox` now returns a Promise that resolves to an IMAPBox, and IMAPBox contains all of the `fetch` operations. This makes the dependency between fetch operations and the currently open mailbox explicit rather than implicit and by forcing the operations to be called on a box instance and hopefully prevent errors. It will also throw an error if the constraint is no longer satisfied. - `fetch` operations now return an observable stream of messages (or Promise for single value), while preserving the same logic of the original implementation. You can use `.toPromise()` on the observable to get a Promise that resolves when the observable stream has completely drained. - Fixes error handling in a few places and renames some variables	2016-06-26 01:57:33 -07:00
Ben Gotow	69e87cbf49	Gmail auth at http://localhost:5100/auth/gmail	2016-06-24 16:46:41 -07:00
Ben Gotow	eac019f536	Rather than changing policies, just set expiring redis key to track activity	2016-06-23 16:28:48 -07:00
Ben Gotow	09bb7874f8	Dashboard with a sweet background. Also realtime assignment / policy view.	2016-06-23 15:52:53 -07:00
Evan Morikawa	3f5cac4342	Adding in syncback message actions	2016-06-23 16:47:07 -06:00
Evan Morikawa	6ad9cdd322	Fixing broken processors	2016-06-23 14:15:30 -06:00
Evan Morikawa	1460a0ae9f	Rename Refresh to Sync	2016-06-23 13:16:15 -06:00
Ben Gotow	8e692982bb	Remove concept of self-limiting workers, will use cloudwatch metrics collection to scale fleet instead of queue length	2016-06-23 12:02:57 -07:00
Ben Gotow	f7c647f7ba	Return syncs to unclaimed queue after CLAIM_DURATION, just because it's healthy	2016-06-23 11:45:33 -07:00
Jackie Luo	ae54192ed6	Update threading and fix typo	2016-06-23 10:35:47 -07:00
Ben Gotow	12d9db8dd9	Redis coordination of sync processes / assignment	2016-06-23 00:49:26 -07:00
Ben Gotow	2e9bfa68b5	Refactor DeltaStreamQueue (connection per subscription)	2016-06-23 00:49:26 -07:00
Ben Gotow	f5f435236f	/auth + remove hardcoded stub in favor of curl request	2016-06-22 17:19:48 -07:00
Evan Morikawa	18f2925b43	Convert to monorepo	2016-06-22 14:41:32 -07:00