2962 Commits

Author SHA1 Message Date
IrynaMatveieva
65bd9d9886 merge with feature/calculated-fields 2025-02-13 09:14:38 +02:00
IrynaMatveieva
621a0984aa changed rate limits validation and added validation on state size 2025-02-12 17:08:56 +02:00
Andrii Shvaika
d7412edceb Refactoring of the arguments 2025-02-12 16:40:58 +02:00
dashevchenko
4474df769b fetch entities only on subs creation 2025-02-12 15:38:25 +02:00
Andrew Shvayka
47b8546988
Merge pull request #12595 from zzzeebra/test_DeleteAttributeAndRPCSubscriptions
Added test to verify attribute and RPC subscriptions removal
2025-02-11 19:03:30 +02:00
yevhenii_zahrebelnyi
ca1c8f71c0
Merge branch 'rc' into error-processing-device-profile 2025-02-11 16:59:51 +02:00
Volodymyr Babak
3860d79613 Improved Edge handling in case connect/disconnect. Speed up initial setup 2025-02-10 18:42:25 +02:00
dashevchenko
5563da7c0d implemented filters for AlarmCountQuery 2025-02-10 16:28:59 +02:00
Viacheslav Klimov
feeee23fa0
Merge pull request #12649 from thingsboard/rc
rc
2025-02-10 15:35:43 +02:00
IrynaMatveieva
1256993569 added new tests and fix proto serialization 2025-02-10 12:59:21 +02:00
IrynaMatveieva
c6f6408c22 refactored tests 2025-02-07 17:04:01 +02:00
IrynaMatveieva
fe4d2ba497 added tests 2025-02-07 14:24:39 +02:00
IrynaMatveieva
7fcd948071 fixed error when no telemetry in db 2025-02-06 16:11:58 +02:00
Dmytro Skarzhynets
b2b33199fe
Corrections after code review 2025-02-06 15:55:41 +02:00
Dmytro Skarzhynets
54afdaa07a
Do not copy latest to entity views when data was not saved on the main entity 2025-02-06 15:15:38 +02:00
yevhenii
3a32bf81da Fix error in device profile processing
- Added and fixed test
2025-02-06 13:20:25 +02:00
Andrew Shvayka
8fc7ae2897
Merge pull request #12565 from jekka001/error-processing-resources
Fix error in resource processing
2025-02-06 12:22:36 +02:00
dashevchenko
f128f49d44 test fixes 2025-02-05 18:57:23 +02:00
dashevchenko
09bd3de984 test fixes 2025-02-05 16:42:31 +02:00
Oleksandra Matviienko
139c0c1d04 Type casting was performed in the Test class
Signed-off-by: Oleksandra Matviienko <al.zzzeebra@gmail.com>
2025-02-05 13:25:00 +01:00
dashevchenko
b2bf5b9f65 configurable edqs sync batch sizes 2025-02-05 12:20:23 +02:00
Oleksandra Matviienko
76155aca75 Added test to verify attribute and RPC subscriptions removal on session overflow.
Signed-off-by: Oleksandra Matviienko <al.zzzeebra@gmail.com>
2025-02-04 21:24:24 +01:00
Volodymyr Babak
4657e66d92 Fixed assignemnt/unassignemnt of dashboards 2025-02-04 17:15:43 +02:00
IrynaMatveieva
d14d0d4e8a used limits for state persistence 2025-02-04 17:03:25 +02:00
yevhenii
0dface5490 Fix error in resource processing
- Added update JKS resource on Cloud
2025-02-04 16:41:13 +02:00
dashevchenko
60736e1237 fixed entity removal from CustomerData 2025-02-04 12:23:35 +02:00
dashevchenko
0e9d0b3ba3 fixed EntityServiceTest 2025-02-03 18:27:36 +02:00
IrynaMatveieva
1a67769f1c added api limits and fixed tests 2025-02-03 12:01:06 +02:00
Volodymyr Babak
3b8be75a14 DeviceEdgeTest.testSendOutdatedAttributeToCloud - improved stability for concurrent issue 2025-01-31 18:24:50 +02:00
IrynaMatveieva
6905cb530b added new protos for states 2025-01-31 17:12:02 +02:00
ViacheslavKlimov
c8db304ce6 Optimized postgres sync (#3208)
* optimized postgres sync

* Fix consumer stopping when stopWhenRead enabled

* Fix NPE on EDQS repartitioning

* fixed EntityServiceTest

* Fix EDQS yml props

---------

Co-authored-by: ViacheslavKlimov <viacheslavklimov11@gmail.com>
2025-01-30 12:43:14 +02:00
IrynaMatveieva
5e16db275c state and argument refactoring 2025-01-29 14:44:28 +02:00
Viacheslav Klimov
86b5378d59 EDQS (#3196)
* Experiments with CSV

* CSV Loader v1

* EDQ tests

* Volatile variables instead of final

* Improvements

* updated loader with new entities

* Fix double memory usage issue

* Basic data structures and load

* Minor improvements

* Snappy + Large String reuse

* added EntityFields classes for each entity

* Basic implementation

* Minor improvements to KeyFilters

* implemented RepositoryUtils.checkKeyFilters

* Generic query implementation

* New structure

* Refactoring and few processors implementation

* extended DeviceData with shared/client attributes and device profile

* Minor refactoring of attribute scopes

* DeviceTypeFilter support

* Strong types of fields for each entity data class

* DeviceType and AssetType filters

* EntityView and Edge queries

* Relations Query

* Relation Query Implementation

* Update EDQS module version

* Sync with EDQS via Kafka

* EDQS: major refactoring

* EDQS API requests via Kafka

* EDQS: full sync with the database

* Refactoring for EDQS sync

* EDQS: major refactoring and new features

* EDQS refactoring, count query support, fix tests

* EDQS: refactoring for query processors

* Fix EDQS pom version

* Cleanup edqs.yml

* EDQS: tenant partitioning strategy; refactoring

* EDQS: latest events queue

* EDQS: support for monolith setup; RocksDB; other improvements

* EDQS: merge sync and events topics, introduce state topic

* EDQS: dynamic repartitioning

* implemented entity data query filters for edqs

* EdqsEntityQueryControllerTest - use in-memory queue

* edqs-filter fixes, added test

* EDQS: blob entity support

* EdqsEntityQueryControllerTest - use in-memory queue

* Use DummyEdqsService when disabled

* Fixes for EDQS

* Refactoring for EDQS tests

* Fix edqs requests partitioning

* EDQS: Fix for attributes handling

* Fix attributes saving in EntityServiceTest

* EDQS: refactoring, fixes

* Minor refactoring for query processor

* added ownerName/ownerType support

* fixed relation query processor

* fixed EntityServiceTest

* refactoring

* added support for parentId for relation query result

* Get rid of EntityNameFetcher

* Add fixme for relation query processor

* db restore with select all edqs fields

* fixed entity deletion

* fixed FieldUtils with new EntityFields

* dao method renamed

* EDQS: instance groups with same partitions; automatic sync; multiple fixes

* Refactoring for EDQS sync

* EDQS: refactoring

* Fix startup with Kafka

* fixed EntityQueryControllerTest

* fixed EdqsEntityServiceTest

* Separate queue admin for EDQS request template

* Implement new EDQS partitioning strategy

* EDQS: multiple fixes and refactoring

* Add mock EdqsRocksDb beans to tests

* added edqs stats for inmemory/grafana

* fixed filter tests

* Update todos

* Refactoring for QueueConfig

* Improvements and refactoring for EDQS consumers

* implemented TODOs

* test fixes

* Consume state topic up to end offsets

* edqs stats refactoring

* EDQS: cleanup on partitions removal; refactoring

* EDQS: minor refactoring

* EDQS: remove CSV loader

---------

Co-authored-by: Andrii Shvaika <ashvayka@thingsboard.io>
Co-authored-by: dashevchenko <dshevchenko@thingsboard.io>
2025-01-27 17:41:12 +02:00
Andrii Shvaika
d3278f05bb WIP: Cluster mode refactoring 2025-01-27 17:34:35 +02:00
nick
80284ad7c0 sparkplug: ver 3.0 2025-01-23 16:34:14 +02:00
Dmytro Skarzhynets
f40c1d389e Save time series strategies: merge with master 2025-01-22 18:32:51 +02:00
Igor Kulikov
f920010786 Merge branch 'rc' 2025-01-22 18:25:11 +02:00
yevhenii_zahrebelnyi
9d873cb0bf
Fix telemetry edge test (#12496)
* Fix telemetry edge test

- Changed random failure logic for DownlinkMsg. A DownlinkMsg can fail only twice.

* - add case with failureProbability 100

* - refactored naming
2025-01-22 15:45:39 +02:00
Dmytro Skarzhynets
e009967fa7 Save time series strategies: rename SaveActions to Strategy 2025-01-21 16:21:28 +02:00
Andrii Shvaika
f0a71aa3bd Merge branch 'master' of github.com:thingsboard/thingsboard into feature/calculated-fields 2025-01-21 15:24:49 +02:00
Dmytro Skarzhynets
39e47cd484 Save time series strategies: refactor boolean flags in TimeseriesSaveRequest.java to SaveActions nested record 2025-01-21 14:26:08 +02:00
IrynaMatveieva
d9ccc8118c fixed calculated field controller test 2025-01-21 10:52:06 +02:00
Andrii Landiak
1223347587 Fix testSendOutdatedAttributeToCloud 2025-01-20 16:38:03 +02:00
Dmytro Skarzhynets
3aac81745f Save time series strategies: add test for changes in entity view service 2025-01-16 12:58:22 +02:00
Andrii Landiak
6923639dc5 Fix AlarmControllerTest 2025-01-15 17:42:22 +02:00
Andrii Landiak
e4b5490921 Change ts in test to be for sure condifent 2025-01-15 17:22:14 +02:00
Andrii Landiak
d9dad36c54 Send alarm_ack and alarm_clear only by 'Push to Edge' node 2025-01-15 16:19:56 +02:00
Andrii Landiak
4eedea0766 EntityDataProto: add ts to correctly handle PostAttributeMsg update from/to Edge 2025-01-15 16:11:54 +02:00
Viacheslav Klimov
f4b5c4321b
Merge pull request #12398 from thingsboard/fix_bug_lwm2m_profile_update_dynamic
fix bug: lwm2m update Observe dynamically and between connections
2025-01-14 17:38:25 +02:00
Dmytro Skarzhynets
d1acba40a2 Save time series strategies: add tests for changes in telemetry service 2025-01-14 15:20:16 +02:00