4633 Commits

Author SHA1 Message Date
dashevchenko
93e191856f merged with edqs branch 2025-02-24 12:03:49 +02:00
dashevchenko
fb161730fb added msa tests for edqs 2025-02-21 18:38:26 +02:00
ViacheslavKlimov
278ec36f37 Fixes for EDQS 2025-02-21 15:48:33 +02:00
ViacheslavKlimov
965210f17b Multiple improvements for EDQS 2025-02-21 14:39:26 +02:00
ViacheslavKlimov
347cb5bc36 EDQS code cleanup 2025-02-21 11:48:21 +02:00
ViacheslavKlimov
a48144d2bb EDQS code cleanup 2025-02-20 17:34:28 +02:00
ViacheslavKlimov
92b83335c0 Merge branch 'master' of github.com:thingsboard/thingsboard into edqs 2025-02-20 12:25:17 +02:00
ViacheslavKlimov
7519889c1a Refactoring for EDQS repartitioning 2025-02-20 12:25:08 +02:00
ViacheslavKlimov
6bf56c8dc2 EDQS repartitioning improvements 2025-02-19 15:54:18 +02:00
ViacheslavKlimov
ded6daf2b3 Kafka states restore improvements 2025-02-19 15:44:05 +02:00
dashevchenko
e1e6f7c98b merged with opensource 2025-02-19 14:59:03 +02:00
dashevchenko
46005a957a fixed test 2025-02-19 14:46:39 +02:00
dashevchenko
2580f4d3e5 fixed buildEntityDataQuery for AlarmDataQuery, key filtering for string null values 2025-02-19 12:05:05 +02:00
ViacheslavKlimov
2a003709e0 Fix tests 2025-02-19 11:21:01 +02:00
ViacheslavKlimov
fc5af45519 EDQS: optimize attributes and latest kv 2025-02-18 17:03:22 +02:00
ViacheslavKlimov
6dd08276f8 Merge branch 'rc' of github.com:thingsboard/thingsboard 2025-02-14 13:45:35 +02:00
ViacheslavKlimov
2a72516106 Merge branch 'master' of github.com:thingsboard/thingsboard into edqs 2025-02-14 13:38:23 +02:00
ViacheslavKlimov
13fbcf4ba0 Fix init for readiness probe controller 2025-02-14 12:31:36 +02:00
ViacheslavKlimov
bb7ea08e59 EDQS: refactoring, OOM handling, healthcheck 2025-02-14 12:08:05 +02:00
Volodymyr Babak
1b4930ebaf Introduced separate count for edge consumers 2025-02-10 18:51:13 +02:00
Volodymyr Babak
3860d79613 Improved Edge handling in case connect/disconnect. Speed up initial setup 2025-02-10 18:42:25 +02:00
Viacheslav Klimov
feeee23fa0
Merge pull request #12649 from thingsboard/rc
rc
2025-02-10 15:35:43 +02:00
ViacheslavKlimov
be836eab71 Resolve gateway dashboard branch automatically 2025-02-06 15:35:09 +02:00
artem-barysh-dev
3370935be8
MQTT: fix unsubscribe error without previous subscribe (#12575)
improved formatting and moved check to recordActivityInternal.

Added warn log and check on provision

Updated license format
2025-02-05 19:15:14 +02:00
dashevchenko
b2bf5b9f65 configurable edqs sync batch sizes 2025-02-05 12:20:23 +02:00
dashevchenko
60736e1237 fixed entity removal from CustomerData 2025-02-04 12:23:35 +02:00
dashevchenko
0e9d0b3ba3 fixed EntityServiceTest 2025-02-03 18:27:36 +02:00
Viacheslav Klimov
85d2867282
Merge pull request #12562 from thingsboard/rc
rc
2025-01-31 12:36:24 +02:00
ViacheslavKlimov
c8db304ce6 Optimized postgres sync (#3208)
* optimized postgres sync

* Fix consumer stopping when stopWhenRead enabled

* Fix NPE on EDQS repartitioning

* fixed EntityServiceTest

* Fix EDQS yml props

---------

Co-authored-by: ViacheslavKlimov <viacheslavklimov11@gmail.com>
2025-01-30 12:43:14 +02:00
Viacheslav Klimov
86b5378d59 EDQS (#3196)
* Experiments with CSV

* CSV Loader v1

* EDQ tests

* Volatile variables instead of final

* Improvements

* updated loader with new entities

* Fix double memory usage issue

* Basic data structures and load

* Minor improvements

* Snappy + Large String reuse

* added EntityFields classes for each entity

* Basic implementation

* Minor improvements to KeyFilters

* implemented RepositoryUtils.checkKeyFilters

* Generic query implementation

* New structure

* Refactoring and few processors implementation

* extended DeviceData with shared/client attributes and device profile

* Minor refactoring of attribute scopes

* DeviceTypeFilter support

* Strong types of fields for each entity data class

* DeviceType and AssetType filters

* EntityView and Edge queries

* Relations Query

* Relation Query Implementation

* Update EDQS module version

* Sync with EDQS via Kafka

* EDQS: major refactoring

* EDQS API requests via Kafka

* EDQS: full sync with the database

* Refactoring for EDQS sync

* EDQS: major refactoring and new features

* EDQS refactoring, count query support, fix tests

* EDQS: refactoring for query processors

* Fix EDQS pom version

* Cleanup edqs.yml

* EDQS: tenant partitioning strategy; refactoring

* EDQS: latest events queue

* EDQS: support for monolith setup; RocksDB; other improvements

* EDQS: merge sync and events topics, introduce state topic

* EDQS: dynamic repartitioning

* implemented entity data query filters for edqs

* EdqsEntityQueryControllerTest - use in-memory queue

* edqs-filter fixes, added test

* EDQS: blob entity support

* EdqsEntityQueryControllerTest - use in-memory queue

* Use DummyEdqsService when disabled

* Fixes for EDQS

* Refactoring for EDQS tests

* Fix edqs requests partitioning

* EDQS: Fix for attributes handling

* Fix attributes saving in EntityServiceTest

* EDQS: refactoring, fixes

* Minor refactoring for query processor

* added ownerName/ownerType support

* fixed relation query processor

* fixed EntityServiceTest

* refactoring

* added support for parentId for relation query result

* Get rid of EntityNameFetcher

* Add fixme for relation query processor

* db restore with select all edqs fields

* fixed entity deletion

* fixed FieldUtils with new EntityFields

* dao method renamed

* EDQS: instance groups with same partitions; automatic sync; multiple fixes

* Refactoring for EDQS sync

* EDQS: refactoring

* Fix startup with Kafka

* fixed EntityQueryControllerTest

* fixed EdqsEntityServiceTest

* Separate queue admin for EDQS request template

* Implement new EDQS partitioning strategy

* EDQS: multiple fixes and refactoring

* Add mock EdqsRocksDb beans to tests

* added edqs stats for inmemory/grafana

* fixed filter tests

* Update todos

* Refactoring for QueueConfig

* Improvements and refactoring for EDQS consumers

* implemented TODOs

* test fixes

* Consume state topic up to end offsets

* edqs stats refactoring

* EDQS: cleanup on partitions removal; refactoring

* EDQS: minor refactoring

* EDQS: remove CSV loader

---------

Co-authored-by: Andrii Shvaika <ashvayka@thingsboard.io>
Co-authored-by: dashevchenko <dshevchenko@thingsboard.io>
2025-01-27 17:41:12 +02:00
Sergey Matvienko
6e5e81cf1d log debug for AbstractGatewaySessionHandler 2025-01-22 17:57:14 +01:00
Sergey Matvienko
0bb262dda3 AbstractGatewaySessionHandler - add deregister callback for device creation futures on Gateway disconnect event 2025-01-22 10:18:18 +01:00
Sergey Matvienko
4a25248e7e ToString and Getter added to some MQTT transport sessions 2025-01-20 12:23:42 +01:00
Sergey Matvienko
a7254c46f9 DefaultTransportMBeanConfiguration 2025-01-20 12:23:09 +01:00
Viacheslav Klimov
e20461113f
Merge pull request #12450 from volodymyr-babak/edge-4-0-client
Set Edge Client version to 4.0.0
2025-01-15 10:46:44 +02:00
Viacheslav Klimov
ab2b1d7ff8
Merge pull request #12451 from thingsboard/rc
rc
2025-01-14 17:42:01 +02:00
Viacheslav Klimov
e9036f8aa8
Merge pull request #12427 from YevhenBondarenko/fix/lwm2m
[Transport] lwm2m client serialization fixes
2025-01-14 17:39:59 +02:00
Viacheslav Klimov
f4b5c4321b
Merge pull request #12398 from thingsboard/fix_bug_lwm2m_profile_update_dynamic
fix bug: lwm2m update Observe dynamically and between connections
2025-01-14 17:38:25 +02:00
Volodymyr Babak
48d61db4f5 Set Edge Client version to 4.0.0 2025-01-14 17:28:38 +02:00
ViacheslavKlimov
1c7e3c169d Fix push result status check 2025-01-14 13:30:35 +02:00
dashevchenko
2bb368b45d return empty object for app store and version info to fit UI component behaviour 2025-01-13 12:26:20 +02:00
YevhenBondarenko
4e8c6beee8 fixed lwm2m ResourcModel parsing 2025-01-10 20:48:19 +01:00
YevhenBondarenko
bb93ec7ee1 fexed NPE during LwM2mClient serializeation 2025-01-10 20:42:31 +01:00
Andrew Shvayka
801c06aea0
Merge pull request #12405 from thingsboard/tbel_new_bytes_parsing_methods
tbel: add hexToBytesArray, base64ToBytesList
2025-01-10 16:48:17 +02:00
nick
80e93d8a40 Merge branch 'master' into fix_bug_lwm2m_profile_update_dynamic 2025-01-09 17:44:47 +02:00
nick
d961b89f31 tbel: add hexToBytesArray, base64ToBytesList 2025-01-08 16:17:14 +02:00
nick
e5df59456a fix bug: update Observe dynamically and between connections due to profile changes 2025-01-07 18:40:19 +02:00
Kulikov
c5ca395844
fix_bug_coaps_x509_docker_many_devices (#12327)
* coaps: x509 - tests

* coaps: x509 - tests add sever cert.pem

* coaps: x509 - tests add sever cert.pem -2

* coaps: x509 - tests add sever cert.pem -3

* coaps: x509 - tests add sever cert.pem -4

* fix bug: coaps x509 - ddocker many devices with re-port

* fix bug: coaps - add test, connect client with X509

* fix bug: coaps - add two test devices with the same port

* fix bug: coaps - add two test devices with the same port (FeatureType.ATTRIBUTES)

* fix bug: coaps - add two test devices with the same port (FeatureType.ATTRIBUTES) - 1

* fix bug: coap comments 1
2025-01-03 18:17:30 +02:00
Viacheslav Klimov
0a1f377347
Merge pull request #12199 from thingsboard/develop/4.0
develop/4.0
2025-01-02 10:47:58 +02:00
Igor Kulikov
1a8116cb93 Merge with rc 2024-12-31 11:52:06 +02:00