Commit graph

108 commits

Author SHA1 Message Date
Max Ma
65faf73fe9
NET-1226: Scalability Improvements (#2987)
* add api to check if failover node existed

* remove 5 minute peerUpdate

* update peerUpdate to trigger pull

* update Action name to SignalPull

* revert the peerUpdate from SignalPull

* fix getfailover error issue

* rm acls creation for on-prem emqx

* remove use of acls

* add additional broker status field on status api

* NET-1165: Remove creation of acls on emqx (#2996)

* rm acls creation for on-prem emqx

* remove use of acls

* add additional broker status field on status api

* comment out mq reconnect logic

* configure mq conn params

* add metric_interval in ENV for publishing metrics

* add metric_interval in ENV for publishing metrics

* update PUBLISH_METRIC_INTERVAL env name

* revert the mq setttings back

* fix error nil issue

---------

Co-authored-by: abhishek9686 <abhi281342@gmail.com>
Co-authored-by: Abhishek K <32607604+abhishek9686@users.noreply.github.com>
2024-07-09 18:56:55 +05:30
abhishek9686
72577a96d9 replace peer on first peer update 2024-05-17 12:02:47 +05:30
abhishek9686
3ed183344b send peer update on startup 2024-05-17 11:28:53 +05:30
abhishek9686
5ff9289462 set random id 2024-04-16 10:50:31 +05:30
Abhishek K
66069fbc34
NET-1082: Scale Testing Fixes (#2894)
* add additional mutex lock on node acls func

* increase verbosity

* disable acls on cloud emqx

* add emqx creds creation to go routine

* add debug log of mq client id

* comment port check

* uncomment port check

* check for connection mq connection open

* use username for client id

* add write mutex on acl is allowed

* add mq connection lost handler on server

* spin off zombie init as go routine

* get whole api path from config

* Revert "get whole api path from config"

This reverts commit 392f5f4c5f.

* update extclient acls async

* add additional mutex lock on node acls func

(cherry picked from commit 5325f0e7d7)

* increase verbosity

(cherry picked from commit 705b3cf0bf)

* add emqx creds creation to go routine

(cherry picked from commit c8e65f4820)

* add debug log of mq client id

(cherry picked from commit 29c5d6ceca)

* comment port check

(cherry picked from commit db8d6d95ea)

* check for connection mq connection open

(cherry picked from commit 13b11033b0)

* use username for client id

(cherry picked from commit e90c7386de)

* add write mutex on acl is allowed

(cherry picked from commit 4cae1b0bb4)

* add mq connection lost handler on server

(cherry picked from commit c82918ad35)

* spin off zombie init as go routine

(cherry picked from commit 6d65c44c43)

* update extclient acls async

(cherry picked from commit 6557ef1ebe)

* additionl logs for oauth user flow

(cherry picked from commit 61703038ae)

* add more debug logs

(cherry picked from commit 5980beacd1)

* add more debug logs

(cherry picked from commit 4d001f0d27)

* add set auth secret

(cherry picked from commit f41cef5da5)

* fix fetch pass

(cherry picked from commit 825caf4b60)

* make sure auth secret is set only once

(cherry picked from commit ba33ed02aa)

* make sure auth secret is set only once

(cherry picked from commit 920ac4c507)

* comment usage of emqx acls

* replace  read lock with write lock on acls

* replace  read lock with write lock on acls

(cherry picked from commit 808d2135c8)

* use deadlock pkg for visibility

* add additional mutex locks

* remove race flag

* on mq re-connecting donot exit if failed

* on mq re-connecting donot exit if failed

* revert mutex package change

* set mq clean session

* remove debug log

* go mod tidy

* revert on prem emqx acls del
2024-04-11 21:18:57 +05:30
Abhishek K
c7e673fb9f
ACC-532: set mq clean session to true (#2865)
* set clean session

* delete emqx hosts creds api

* add emqx hosts del api to limited middleware controller

* add emqx hosts del api to limited middleware controller

* remove server creds from emqx
2024-03-20 15:03:41 +07:00
abhishek9686
a5dff67bfd delete server user on start up to re-initialize 2024-03-05 11:48:24 +07:00
abhishek9686
fb0fead2f0 create emqx for server, get app creds from env 2024-01-26 10:24:29 +05:30
abhishek9686
c556e9d77d add host acls and create user cloud emqx funcs 2024-01-25 18:24:43 +05:30
abhishek9686
155f2887b2 implement emqx interface methods for cloud and on-prem 2024-01-25 15:11:16 +05:30
Abhishek Kondur
8d874b876b set mq order matters to false 2023-06-28 08:34:14 +05:30
Matthew R Kasun
6d6ba3aa7d random string
update algorithm
consolidate MakeRandomString, RandomString & GenerateCrytoString into
one function
2023-05-02 13:28:00 -04:00
dcarns
158672a906
Merge pull request #2097 from gravitl/feature_emqx_acl
Add EMQX ACLs
2023-03-22 11:56:56 -04:00
Anish Mukherjee
8a9f569c4f add emqx acls 2023-03-21 17:47:57 +05:30
0xdcarns
8f8b4c8b70 merge develop 2023-03-20 17:05:41 -04:00
0xdcarns
bf687dd478 add return 2023-03-20 08:55:28 -04:00
Anish Mukherjee
0e9c549d1b add server name to common topics 2023-03-16 16:39:41 +05:30
dcarns
dbf6f1034b
Merge pull request #2058 from gravitl/feature_emqx
Add emqx boilerplate
2023-02-28 08:41:39 -05:00
0xdcarns
5014c389ca adjusted main to use one single context 2023-02-24 15:46:06 -05:00
Anish Mukherjee
5279900b7c add /mqtt for EMQX websocket listen endpoint 2023-02-22 20:37:08 +05:30
Anish Mukherjee
c7a3306d3e refresh emqx admin user on server startup 2023-02-22 20:37:08 +05:30
Anish Mukherjee
a33ac33462 wait for EMQX rest endpoint startup 2023-02-22 20:37:08 +05:30
Anish Mukherjee
d2adf88b21 add emqx boilerplate 2023-02-22 20:37:08 +05:30
dcarns
d5c85b1d87
Merge pull request #2002 from gravitl/GRA-1011/remove_mq_dyn_sec
Gra 1011/remove mq dyn sec
2023-02-08 08:55:23 -05:00
0xdcarns
7a2c225eb1 added mq and database connected funcs and endpoint 2023-02-06 12:09:21 -05:00
Abhishek Kondur
81e9febf2a rm mq dynamic security, add mq username,password to config 2023-01-19 23:11:28 +05:30
Abhishek Kondur
55731ae547 change topic for server host update 2023-01-17 18:36:03 +05:30
0xdcarns
2fa2d50b8f added ability for server to receive and publish host model updates via MQ 2023-01-11 10:33:43 -05:00
Abhishek Kondur
0df6d1761e add subscription pattern to acls,fix NaN value in metrics for uptime,get real iface name for mac 2022-09-30 18:31:57 +05:30
Abhishek Kondur
677d9fcc8d added comments 2022-09-29 23:59:18 +05:30
Abhishek Kondur
f632bec11d merge conflicts resolved 2022-09-26 17:47:20 +05:30
Abhishek Kondur
698a4be861 configure mq on startup 2022-09-26 16:57:10 +05:30
Abhishek Kondur
bcaf009cd7 disconnect mq conn after updating admin password 2022-09-16 15:53:31 +05:30
Abhishek Kondur
1b4128bf69 configure mq to update admin password 2022-09-16 15:40:42 +05:30
Abhishek Kondur
2eb5cde6ab dyn sec netclient changes 2022-09-16 11:35:28 +05:30
Abhishek Kondur
7db3bd3aca comment certs code for mq 2022-09-15 09:23:33 +05:30
Abhishek Kondur
5270c1ede8 watch dynsec messages,create client on node join 2022-09-14 15:59:22 +05:30
0xdcarns
88cd0a6497 initial commit 2022-09-13 15:25:56 -04:00
Abhishek Kondur
08a6ed483c dynsec intial code 2022-09-13 23:33:39 +05:30
Matthew R. Kasun
c9037db19f remove debugging logs 2022-08-29 14:29:28 -04:00
Matthew R. Kasun
49c6380643 reuse mq connections 2022-08-29 14:08:01 -04:00
0xdcarns
edcbc912a0 added option for insecure mqtt connections 2022-07-07 15:38:13 -04:00
0xdcarns
393102ad69 first connection established 2022-07-05 16:27:17 -04:00
0xdcarns
adaf8f1ca6 initial changes to make cert <-> broker comms work 2022-07-05 15:04:45 -04:00
Matthew R Kasun
66b2a28455 update server mq connection logic to match client 2022-06-24 19:58:16 +00:00
Matthew R. Kasun
976ab07de1 use token.WaitTimeout() 2022-05-16 09:38:47 -04:00
Matthew R. Kasun
501108b53d Remove config.Server.Debug
no longer required with move to logger.Log and it's verbosity
capabilities
2022-05-09 09:49:17 -04:00
0xdcarns
407e46c117 began servside refactor 2022-02-16 20:44:17 -05:00
0xdcarns
867e253c3b refactored and cleaned up code, added peer update from clients 2022-02-16 20:44:15 -05:00
0xdcarns
98609ac61e implmented chunking 2022-02-15 10:15:17 -05:00