236 Commits

Author SHA1 Message Date
ViacheslavKlimov
43f9083f70 Merge branch 'master' of github.com:thingsboard/thingsboard into edqs 2025-02-28 17:12:33 +02:00
Andrew Shvayka
441940c497
Merge pull request #12374 from thingsboard/feature/calculated-fields
Calculated Fields
2025-02-28 16:12:10 +02:00
Dmytro Skarzhynets
2f22a5e581
Save time series strategies: ensure Device State Service is notified about inactivity timeout updates 2025-02-28 11:36:42 +02:00
Andrii Landiak
94ec82ea6d Merge remote-tracking branch 'upstream/feature/calculated-fields' into feature/calculated-fields-vc 2025-02-28 11:29:38 +02:00
Andrii Shvaika
62da129d6b Review comments fixed 2025-02-27 16:46:55 +02:00
ViacheslavKlimov
05567f4937 Merge branch 'master' of github.com:thingsboard/thingsboard into edqs 2025-02-27 15:58:36 +02:00
IrynaMatveieva
c5ac1771eb fixed conflicts 2025-02-26 16:04:27 +02:00
Andrii Landiak
f9c2f97df3 Merge remote-tracking branch 'upstream/feature/calculated-fields' into feature/calculated-fields-vc 2025-02-26 11:55:36 +02:00
IrynaMatveieva
49328d270b wip ts/attributes deletion 2025-02-25 17:13:05 +02:00
Artem Barysh
f3dd0ba82c Merge remote-tracking branch 'origin' into api-usage-version 2025-02-25 12:00:24 +02:00
ViacheslavKlimov
44439584f4 Merge branch 'master' of github.com:thingsboard/thingsboard into feature/calculated-fields 2025-02-25 11:49:56 +02:00
ViacheslavKlimov
e7ed98910a Merge branch 'master' of github.com:thingsboard/thingsboard into edqs 2025-02-25 11:10:31 +02:00
Viacheslav Klimov
6acc85e79f
Merge pull request #12448 from AndriiLandiak/edge-attribute-update-improvement
Edge - improve attribute update strategy
2025-02-25 11:01:00 +02:00
Igor Kulikov
5cf26d4851 Update license header 2025-02-25 09:39:16 +02:00
Igor Kulikov
b7750bc342 Version set to 4.0.0-SNAPSHOT 2025-02-25 09:28:44 +02:00
Igor Kulikov
6a0fff0737 Version set to 3.9.1-RC 2025-02-25 09:27:01 +02:00
Andrii Landiak
c31da287ac Merge remote-tracking branch 'upstream/master' into edge-attribute-update-improvement 2025-02-24 17:44:45 +02:00
ViacheslavKlimov
fc5af45519 EDQS: optimize attributes and latest kv 2025-02-18 17:03:22 +02:00
Andrii Shvaika
3cdc933b67 Merge improvements 2025-02-18 13:02:48 +02:00
Andrii Landiak
44a7bf82c4 Fix ComponentLifecycleMsg: message and builder 2025-02-17 18:00:12 +02:00
IrynaMatveieva
5e9ee15b1d fixed proto utils test 2025-02-17 14:55:04 +02:00
Artem Barysh
61f77f301d Resolved review comments 2025-02-14 19:21:03 +02:00
ViacheslavKlimov
b4258ad882 Merge branch 'feature/calculated-fields' of github.com:thingsboard/thingsboard into feature/cf-states-restore 2025-02-13 14:47:43 +02:00
ViacheslavKlimov
677385e8ba CF states restore from Kafka 2025-02-13 13:01:17 +02:00
IrynaMatveieva
65bd9d9886 merge with feature/calculated-fields 2025-02-13 09:14:38 +02:00
IrynaMatveieva
621a0984aa changed rate limits validation and added validation on state size 2025-02-12 17:08:56 +02:00
Andrii Shvaika
d7412edceb Refactoring of the arguments 2025-02-12 16:40:58 +02:00
IrynaMatveieva
1256993569 added new tests and fix proto serialization 2025-02-10 12:59:21 +02:00
IrynaMatveieva
0295fefb02 fixed limits 2025-02-04 12:02:39 +02:00
IrynaMatveieva
7e055ec353 merge with feature/calculated-fields 2025-02-03 08:34:59 +02:00
IrynaMatveieva
6905cb530b added new protos for states 2025-01-31 17:12:02 +02:00
Andrii Shvaika
83b338c697 Entity lifecycle implementation 2025-01-31 13:54:53 +02:00
IrynaMatveieva
c1c9fb4f5a implemented calculated field debug events persistence 2025-01-31 11:29:38 +02:00
Andrii Shvaika
5aabbd0f1e Link dispatch implementation 2025-01-29 15:37:36 +02:00
IrynaMatveieva
71bb1c0250 merge with upstream 2025-01-28 09:51:30 +02:00
Andrii Shvaika
3d42a4ca04 Actor system implementation draft 2025-01-27 17:57:39 +02:00
Viacheslav Klimov
86b5378d59 EDQS (#3196)
* Experiments with CSV

* CSV Loader v1

* EDQ tests

* Volatile variables instead of final

* Improvements

* updated loader with new entities

* Fix double memory usage issue

* Basic data structures and load

* Minor improvements

* Snappy + Large String reuse

* added EntityFields classes for each entity

* Basic implementation

* Minor improvements to KeyFilters

* implemented RepositoryUtils.checkKeyFilters

* Generic query implementation

* New structure

* Refactoring and few processors implementation

* extended DeviceData with shared/client attributes and device profile

* Minor refactoring of attribute scopes

* DeviceTypeFilter support

* Strong types of fields for each entity data class

* DeviceType and AssetType filters

* EntityView and Edge queries

* Relations Query

* Relation Query Implementation

* Update EDQS module version

* Sync with EDQS via Kafka

* EDQS: major refactoring

* EDQS API requests via Kafka

* EDQS: full sync with the database

* Refactoring for EDQS sync

* EDQS: major refactoring and new features

* EDQS refactoring, count query support, fix tests

* EDQS: refactoring for query processors

* Fix EDQS pom version

* Cleanup edqs.yml

* EDQS: tenant partitioning strategy; refactoring

* EDQS: latest events queue

* EDQS: support for monolith setup; RocksDB; other improvements

* EDQS: merge sync and events topics, introduce state topic

* EDQS: dynamic repartitioning

* implemented entity data query filters for edqs

* EdqsEntityQueryControllerTest - use in-memory queue

* edqs-filter fixes, added test

* EDQS: blob entity support

* EdqsEntityQueryControllerTest - use in-memory queue

* Use DummyEdqsService when disabled

* Fixes for EDQS

* Refactoring for EDQS tests

* Fix edqs requests partitioning

* EDQS: Fix for attributes handling

* Fix attributes saving in EntityServiceTest

* EDQS: refactoring, fixes

* Minor refactoring for query processor

* added ownerName/ownerType support

* fixed relation query processor

* fixed EntityServiceTest

* refactoring

* added support for parentId for relation query result

* Get rid of EntityNameFetcher

* Add fixme for relation query processor

* db restore with select all edqs fields

* fixed entity deletion

* fixed FieldUtils with new EntityFields

* dao method renamed

* EDQS: instance groups with same partitions; automatic sync; multiple fixes

* Refactoring for EDQS sync

* EDQS: refactoring

* Fix startup with Kafka

* fixed EntityQueryControllerTest

* fixed EdqsEntityServiceTest

* Separate queue admin for EDQS request template

* Implement new EDQS partitioning strategy

* EDQS: multiple fixes and refactoring

* Add mock EdqsRocksDb beans to tests

* added edqs stats for inmemory/grafana

* fixed filter tests

* Update todos

* Refactoring for QueueConfig

* Improvements and refactoring for EDQS consumers

* implemented TODOs

* test fixes

* Consume state topic up to end offsets

* edqs stats refactoring

* EDQS: cleanup on partitions removal; refactoring

* EDQS: minor refactoring

* EDQS: remove CSV loader

---------

Co-authored-by: Andrii Shvaika <ashvayka@thingsboard.io>
Co-authored-by: dashevchenko <dshevchenko@thingsboard.io>
2025-01-27 17:41:12 +02:00
IrynaMatveieva
0e1cd69e34 updated cf consumer 2025-01-27 15:55:40 +02:00
IrynaMatveieva
a652b31d7f implementation processing notification 2025-01-24 15:41:00 +02:00
IrynaMatveieva
5641626443 added processNotification impl 2025-01-24 10:53:13 +02:00
Andrii Shvaika
069725a2b9 WIP Refactoring of the cluster mode 2025-01-23 10:43:26 +02:00
Andrii Shvaika
6b9d374a5f Tmp commit for merge 2025-01-22 12:23:42 +02:00
Andrii Landiak
4eedea0766 EntityDataProto: add ts to correctly handle PostAttributeMsg update from/to Edge 2025-01-15 16:11:54 +02:00
YevhenBondarenko
933d1447d2 refactoring due to comments (removed serviceId duplications in ToUsageStatsServiceMsgPack) 2025-01-14 12:08:53 +01:00
YevhenBondarenko
87f0483019 merge with master 2025-01-13 19:27:17 +01:00
IrynaMatveieva
5203ef7422 added calculated field state service 2025-01-09 14:45:42 +02:00
IrynaMatveieva
46180e33d7 cache refactoring 2025-01-08 17:20:20 +02:00
IrynaMatveieva
03c3341265 added logic to send msgs to RE when not my partition 2025-01-08 12:39:49 +02:00
Andrii Shvaika
7d8a76ce7f Draft of the review 2025-01-06 15:32:23 +02:00
IrynaMatveieva
4ba131ad85 changed partititoning implementation 2025-01-06 14:15:32 +02:00