252 Commits

Author SHA1 Message Date
IrynaMatveieva
71bb1c0250 merge with upstream 2025-01-28 09:51:30 +02:00
Andrii Shvaika
3d42a4ca04 Actor system implementation draft 2025-01-27 17:57:39 +02:00
Viacheslav Klimov
86b5378d59 EDQS (#3196)
* Experiments with CSV

* CSV Loader v1

* EDQ tests

* Volatile variables instead of final

* Improvements

* updated loader with new entities

* Fix double memory usage issue

* Basic data structures and load

* Minor improvements

* Snappy + Large String reuse

* added EntityFields classes for each entity

* Basic implementation

* Minor improvements to KeyFilters

* implemented RepositoryUtils.checkKeyFilters

* Generic query implementation

* New structure

* Refactoring and few processors implementation

* extended DeviceData with shared/client attributes and device profile

* Minor refactoring of attribute scopes

* DeviceTypeFilter support

* Strong types of fields for each entity data class

* DeviceType and AssetType filters

* EntityView and Edge queries

* Relations Query

* Relation Query Implementation

* Update EDQS module version

* Sync with EDQS via Kafka

* EDQS: major refactoring

* EDQS API requests via Kafka

* EDQS: full sync with the database

* Refactoring for EDQS sync

* EDQS: major refactoring and new features

* EDQS refactoring, count query support, fix tests

* EDQS: refactoring for query processors

* Fix EDQS pom version

* Cleanup edqs.yml

* EDQS: tenant partitioning strategy; refactoring

* EDQS: latest events queue

* EDQS: support for monolith setup; RocksDB; other improvements

* EDQS: merge sync and events topics, introduce state topic

* EDQS: dynamic repartitioning

* implemented entity data query filters for edqs

* EdqsEntityQueryControllerTest - use in-memory queue

* edqs-filter fixes, added test

* EDQS: blob entity support

* EdqsEntityQueryControllerTest - use in-memory queue

* Use DummyEdqsService when disabled

* Fixes for EDQS

* Refactoring for EDQS tests

* Fix edqs requests partitioning

* EDQS: Fix for attributes handling

* Fix attributes saving in EntityServiceTest

* EDQS: refactoring, fixes

* Minor refactoring for query processor

* added ownerName/ownerType support

* fixed relation query processor

* fixed EntityServiceTest

* refactoring

* added support for parentId for relation query result

* Get rid of EntityNameFetcher

* Add fixme for relation query processor

* db restore with select all edqs fields

* fixed entity deletion

* fixed FieldUtils with new EntityFields

* dao method renamed

* EDQS: instance groups with same partitions; automatic sync; multiple fixes

* Refactoring for EDQS sync

* EDQS: refactoring

* Fix startup with Kafka

* fixed EntityQueryControllerTest

* fixed EdqsEntityServiceTest

* Separate queue admin for EDQS request template

* Implement new EDQS partitioning strategy

* EDQS: multiple fixes and refactoring

* Add mock EdqsRocksDb beans to tests

* added edqs stats for inmemory/grafana

* fixed filter tests

* Update todos

* Refactoring for QueueConfig

* Improvements and refactoring for EDQS consumers

* implemented TODOs

* test fixes

* Consume state topic up to end offsets

* edqs stats refactoring

* EDQS: cleanup on partitions removal; refactoring

* EDQS: minor refactoring

* EDQS: remove CSV loader

---------

Co-authored-by: Andrii Shvaika <ashvayka@thingsboard.io>
Co-authored-by: dashevchenko <dshevchenko@thingsboard.io>
2025-01-27 17:41:12 +02:00
IrynaMatveieva
0e1cd69e34 updated cf consumer 2025-01-27 15:55:40 +02:00
IrynaMatveieva
a652b31d7f implementation processing notification 2025-01-24 15:41:00 +02:00
IrynaMatveieva
5641626443 added processNotification impl 2025-01-24 10:53:13 +02:00
Andrii Shvaika
069725a2b9 WIP Refactoring of the cluster mode 2025-01-23 10:43:26 +02:00
Andrii Shvaika
6b9d374a5f Tmp commit for merge 2025-01-22 12:23:42 +02:00
Andrii Landiak
4eedea0766 EntityDataProto: add ts to correctly handle PostAttributeMsg update from/to Edge 2025-01-15 16:11:54 +02:00
YevhenBondarenko
933d1447d2 refactoring due to comments (removed serviceId duplications in ToUsageStatsServiceMsgPack) 2025-01-14 12:08:53 +01:00
YevhenBondarenko
87f0483019 merge with master 2025-01-13 19:27:17 +01:00
IrynaMatveieva
5203ef7422 added calculated field state service 2025-01-09 14:45:42 +02:00
IrynaMatveieva
46180e33d7 cache refactoring 2025-01-08 17:20:20 +02:00
IrynaMatveieva
03c3341265 added logic to send msgs to RE when not my partition 2025-01-08 12:39:49 +02:00
Andrii Shvaika
7d8a76ce7f Draft of the review 2025-01-06 15:32:23 +02:00
IrynaMatveieva
4ba131ad85 changed partititoning implementation 2025-01-06 14:15:32 +02:00
IrynaMatveieva
4ebb68ded6 handled profile updates in cluster 2025-01-03 16:00:35 +02:00
IrynaMatveieva
e787b805da added locking and logic to avoid iteration order issue in map 2024-12-26 17:05:27 +02:00
IrynaMatveieva
2dfbe2240d added implementation to handle profile events when not my partition 2024-12-24 16:25:01 +02:00
IrynaMatveieva
a9f39e4917 added cache class 2024-12-24 12:50:27 +02:00
IrynaMatveieva
7d2160178d merge with master 2024-12-23 11:50:22 +02:00
IrynaMatveieva
5c5dc474cb implemented partitioning 2024-12-19 17:12:59 +02:00
YevhenBondarenko
e0fd611c76 used TbMsgProto instead of ByteString 2024-12-13 14:35:02 +01:00
IrynaMatveieva
3038510150 added implementation for handling profile entities 2024-12-09 11:04:05 +02:00
YevhenBondarenko
eaafdf1f87 implemented sending api usages in pack 2024-12-04 17:05:37 +01:00
Igor Kulikov
77d2826f96 Version set to 4.0.0-SNAPSHOT 2024-12-04 16:53:19 +02:00
Igor Kulikov
190bba72f9 Temp Version set to 3.9.0-RC 2024-12-04 16:52:14 +02:00
Igor Kulikov
8ac0468edd Version set to 4.0.0-SNAPSHOT 2024-12-04 16:51:03 +02:00
Andrew Shvayka
1cd4122037
Merge pull request #11994 from ShvaykaD/feature/close-transport-session-on-rpc-delivery-timeout
Added ability to close transport session on RPC delivery timeout
2024-12-02 11:48:10 +01:00
IrynaMatveieva
2080b439a7 added entity added/deleted events handling 2024-11-28 11:28:51 +02:00
Andrii Landiak
b796355554 Merge remote-tracking branch 'upstream/master' into feature/edge-kafka-events 2024-11-26 09:42:31 +02:00
IrynaMatveieva
31103e90e3 added implementation to handle update entity profiles events 2024-11-22 17:17:59 +02:00
IrynaMatveieva
3072861a8f implemented methods for calculated field update/delete in cluster service 2024-11-13 17:42:55 +02:00
IrynaMatveieva
4d8b62eb21 moved logic of cf add/update/delete msg to a single method 2024-11-13 09:55:03 +02:00
IrynaMatveieva
86dd8e725b added onCalculatedFieldAdded implementation 2024-11-11 17:29:24 +02:00
Andrii Landiak
a6c8b9a526 Fix queue.proto structure of EdgeEventMsg 2024-11-05 17:35:19 +02:00
IrynaMatveieva
03ff7c17ac added calculated field link entity and its dao 2024-11-04 15:57:37 +02:00
ShvaykaD
7b1eefbfb4 Added ability to close transport session on RPC delivery timeout 2024-11-04 12:53:54 +02:00
IrynaMatveieva
32bbd83541 added calculated field entity, dao and controller 2024-10-31 16:42:28 +02:00
dashevchenko
9c9d6d95d4 added mobile app bundle to queue.proto 2024-10-31 14:58:47 +02:00
Andrii Landiak
3ecbd3258e Introduce kafka approach to work with edge-event instead of postgres 2024-10-22 12:38:57 +03:00
Igor Kulikov
fdbe59c610 Version set to 3.9.0-SNAPSHOT 2024-10-14 18:32:35 +03:00
Igor Kulikov
d11f866856 Version set to 3.8.1-RC 2024-10-14 18:27:21 +03:00
Viacheslav Klimov
9f8a4f4139
Merge pull request #11776 from thingsboard/rc
rc
2024-10-01 13:11:41 +03:00
Viacheslav Klimov
4a9fa9f956
Merge pull request #11686 from thingsboard/master-hotfix
hotfix/3.6.1
2024-09-27 16:00:11 +03:00
Igor Kulikov
b4124f7c4c Merge with RC 2024-09-26 11:10:56 +03:00
Igor Kulikov
4d705f26fd Version set to 3.8.0-RC 2024-09-26 11:09:26 +03:00
Igor Kulikov
3dadc34b5b Version set to 3.9.0-SNAPSHOT 2024-09-26 10:38:27 +03:00
Igor Kulikov
4e7176cce7 Version set to 3.8.0-RC 2024-09-26 10:32:23 +03:00
Igor Kulikov
025fb1ca8c Version set to 3.8.0 2024-09-26 09:46:57 +03:00