3818 Commits

Author SHA1 Message Date
ViacheslavKlimov
965210f17b Multiple improvements for EDQS 2025-02-21 14:39:26 +02:00
ViacheslavKlimov
347cb5bc36 EDQS code cleanup 2025-02-21 11:48:21 +02:00
ViacheslavKlimov
8d161382e6 Merge branch 'master' of github.com:thingsboard/thingsboard into feature/calculated-fields 2025-02-20 14:08:43 +02:00
Andrii Shvaika
f6261dd086 Fix tests 2025-02-19 18:13:56 +02:00
IrynaMatveieva
609a5dc34b fixed cache onCfDelete and updated tenant profile properties 2025-02-19 10:18:41 +02:00
IrynaMatveieva
6cf314eaa0 added NaN value when is not number in rolling 2025-02-19 08:35:24 +02:00
Andrii Landiak
dfb0549424 VC support for calculated fields 2025-02-17 16:32:59 +02:00
Artem Barysh
61f77f301d Resolved review comments 2025-02-14 19:21:03 +02:00
Andrii Shvaika
dad0c1fb92 Version set to 3.9.1-RC 2025-02-14 16:32:48 +02:00
ViacheslavKlimov
2a72516106 Merge branch 'master' of github.com:thingsboard/thingsboard into edqs 2025-02-14 13:38:23 +02:00
Andrii Landiak
0e3edb271f Add tests for widget bundle 2025-02-14 13:03:06 +02:00
Andrii Landiak
4ed379db23 Fix JpaWidgetTypeDaoTest 2025-02-14 12:11:37 +02:00
Andrii Landiak
6d840e3686 Improve AbstractEntityInfosConverter 2025-02-14 10:56:59 +02:00
Andrii Landiak
fc513c5a5c Add bundles to widget-type-info 2025-02-13 15:39:38 +02:00
IrynaMatveieva
7232d939d8 fixed cf version 2025-02-13 12:57:26 +02:00
IrynaMatveieva
bd5ecc2e9b added new debug filter property 2025-02-13 11:50:50 +02:00
IrynaMatveieva
4245bd4809 fixed cf debug event filter 2025-02-13 09:56:39 +02:00
dashevchenko
4474df769b fetch entities only on subs creation 2025-02-12 15:38:25 +02:00
dashevchenko
33eac2f778 fixed tests 2025-02-10 17:34:12 +02:00
dashevchenko
5563da7c0d implemented filters for AlarmCountQuery 2025-02-10 16:28:59 +02:00
Artem Barysh
ec8e7a0726 Added versioning for ApiUsageState entity 2025-02-10 14:28:46 +02:00
ViacheslavKlimov
3d40761831 Remove outdated deprecation checks 2025-02-07 16:01:38 +02:00
dashevchenko
3d9897f5af fixed NullPointer exception in CachedAttributesService 2025-02-05 13:30:42 +02:00
Andrii Shvaika
0d57d69964 Merge with main branch 2025-02-05 12:56:10 +02:00
Andrii Shvaika
407511be52 Cache implementation 2025-02-05 12:51:50 +02:00
IrynaMatveieva
3818d1cb68 debug events(wip) 2025-02-05 12:34:10 +02:00
dashevchenko
b2bf5b9f65 configurable edqs sync batch sizes 2025-02-05 12:20:23 +02:00
dashevchenko
60736e1237 fixed entity removal from CustomerData 2025-02-04 12:23:35 +02:00
IrynaMatveieva
0295fefb02 fixed limits 2025-02-04 12:02:39 +02:00
dashevchenko
0e9d0b3ba3 fixed EntityServiceTest 2025-02-03 18:27:36 +02:00
IrynaMatveieva
1a67769f1c added api limits and fixed tests 2025-02-03 12:01:06 +02:00
IrynaMatveieva
c1c9fb4f5a implemented calculated field debug events persistence 2025-01-31 11:29:38 +02:00
ViacheslavKlimov
c8db304ce6 Optimized postgres sync (#3208)
* optimized postgres sync

* Fix consumer stopping when stopWhenRead enabled

* Fix NPE on EDQS repartitioning

* fixed EntityServiceTest

* Fix EDQS yml props

---------

Co-authored-by: ViacheslavKlimov <viacheslavklimov11@gmail.com>
2025-01-30 12:43:14 +02:00
IrynaMatveieva
a4aa2444ac added new endpoint 2025-01-30 11:01:45 +02:00
Andrii Shvaika
3d42a4ca04 Actor system implementation draft 2025-01-27 17:57:39 +02:00
Viacheslav Klimov
86b5378d59 EDQS (#3196)
* Experiments with CSV

* CSV Loader v1

* EDQ tests

* Volatile variables instead of final

* Improvements

* updated loader with new entities

* Fix double memory usage issue

* Basic data structures and load

* Minor improvements

* Snappy + Large String reuse

* added EntityFields classes for each entity

* Basic implementation

* Minor improvements to KeyFilters

* implemented RepositoryUtils.checkKeyFilters

* Generic query implementation

* New structure

* Refactoring and few processors implementation

* extended DeviceData with shared/client attributes and device profile

* Minor refactoring of attribute scopes

* DeviceTypeFilter support

* Strong types of fields for each entity data class

* DeviceType and AssetType filters

* EntityView and Edge queries

* Relations Query

* Relation Query Implementation

* Update EDQS module version

* Sync with EDQS via Kafka

* EDQS: major refactoring

* EDQS API requests via Kafka

* EDQS: full sync with the database

* Refactoring for EDQS sync

* EDQS: major refactoring and new features

* EDQS refactoring, count query support, fix tests

* EDQS: refactoring for query processors

* Fix EDQS pom version

* Cleanup edqs.yml

* EDQS: tenant partitioning strategy; refactoring

* EDQS: latest events queue

* EDQS: support for monolith setup; RocksDB; other improvements

* EDQS: merge sync and events topics, introduce state topic

* EDQS: dynamic repartitioning

* implemented entity data query filters for edqs

* EdqsEntityQueryControllerTest - use in-memory queue

* edqs-filter fixes, added test

* EDQS: blob entity support

* EdqsEntityQueryControllerTest - use in-memory queue

* Use DummyEdqsService when disabled

* Fixes for EDQS

* Refactoring for EDQS tests

* Fix edqs requests partitioning

* EDQS: Fix for attributes handling

* Fix attributes saving in EntityServiceTest

* EDQS: refactoring, fixes

* Minor refactoring for query processor

* added ownerName/ownerType support

* fixed relation query processor

* fixed EntityServiceTest

* refactoring

* added support for parentId for relation query result

* Get rid of EntityNameFetcher

* Add fixme for relation query processor

* db restore with select all edqs fields

* fixed entity deletion

* fixed FieldUtils with new EntityFields

* dao method renamed

* EDQS: instance groups with same partitions; automatic sync; multiple fixes

* Refactoring for EDQS sync

* EDQS: refactoring

* Fix startup with Kafka

* fixed EntityQueryControllerTest

* fixed EdqsEntityServiceTest

* Separate queue admin for EDQS request template

* Implement new EDQS partitioning strategy

* EDQS: multiple fixes and refactoring

* Add mock EdqsRocksDb beans to tests

* added edqs stats for inmemory/grafana

* fixed filter tests

* Update todos

* Refactoring for QueueConfig

* Improvements and refactoring for EDQS consumers

* implemented TODOs

* test fixes

* Consume state topic up to end offsets

* edqs stats refactoring

* EDQS: cleanup on partitions removal; refactoring

* EDQS: minor refactoring

* EDQS: remove CSV loader

---------

Co-authored-by: Andrii Shvaika <ashvayka@thingsboard.io>
Co-authored-by: dashevchenko <dshevchenko@thingsboard.io>
2025-01-27 17:41:12 +02:00
Andrii Shvaika
d3278f05bb WIP: Cluster mode refactoring 2025-01-27 17:34:35 +02:00
IrynaMatveieva
a652b31d7f implementation processing notification 2025-01-24 15:41:00 +02:00
IrynaMatveieva
69dc8b4b5d merge with upstream 2025-01-23 15:56:25 +02:00
IrynaMatveieva
2cc0d6f513 added implementations for consumer/producer methods 2025-01-23 15:49:31 +02:00
Andrii Shvaika
ebfb51a59e Merge PR #12487 2025-01-23 10:47:13 +02:00
IrynaMatveieva
fdada09ea2 Merge branch 'feature/calculated-fields' of github.com:thingsboard/thingsboard into calculated-fields 2025-01-23 10:46:52 +02:00
IrynaMatveieva
c047d5f4f0 added debug event entity 2025-01-22 17:01:28 +02:00
Andrii Shvaika
f0a71aa3bd Merge branch 'master' of github.com:thingsboard/thingsboard into feature/calculated-fields 2025-01-21 15:24:49 +02:00
ViacheslavKlimov
0f34f131c9 Return TimeseriesSaveResult 2025-01-21 14:30:27 +02:00
IrynaMatveieva
f0a36d5008 fixed tests 2025-01-21 10:03:50 +02:00
Viacheslav Klimov
ab2b1d7ff8
Merge pull request #12451 from thingsboard/rc
rc
2025-01-14 17:42:01 +02:00
dashevchenko
55fb35bf44 fixed nullpointer for mobile app bundle id 2025-01-14 14:43:15 +02:00
dashevchenko
2bb368b45d return empty object for app store and version info to fit UI component behaviour 2025-01-13 12:26:20 +02:00
IrynaMatveieva
6611f017c7 changed Argument structure 2025-01-10 16:58:26 +02:00