655 Commits

Author SHA1 Message Date
Andrew Shvayka
1579e1e1a3
Merge pull request #10757 from smatvienko-tb/feature/kafka-confluent-out-of-the-box
Kafka Confluent compatibility out of the box: segment.bytes:52428800
2024-05-22 12:26:40 +03:00
Viacheslav Klimov
5809d014de
Queue option to duplicate msgs to all partitions (#10815)
* Queue config option to duplicate msgs to all partitions

* UI for queue config option to duplicate msgs to all partitions

* Fixes for msg duplication; add tests

* Introduce TbRuleEngineProducerService

* Use TbRuleEngineProducerService in TbClusterService

* Fix DefaultTbClusterServiceTest

* Add correlationId to TbMsg

* Refactor TbMsg

* Support msg duplication for all msg types
2024-05-22 12:11:32 +03:00
ViacheslavKlimov
1a264dafa7 Fix TbKafkaSettingsTest 2024-05-16 14:34:50 +03:00
ViacheslavKlimov
e8d14f37cb Improvements for Kafka admin creation 2024-05-16 13:24:49 +03:00
Sergey Matvienko
d89b14e359 Kafka Confluent compatibility out of the box: segment.bytes:26214400 increased segment.bytes:52428800 2024-05-10 11:45:52 +02:00
ViacheslavKlimov
15d189ead7 Refactoring for consumer manager 2024-05-07 15:13:52 +03:00
ViacheslavKlimov
9f6156a0fb Merge remote-tracking branch 'origin/master' into feature/parallel-core-consumer 2024-05-07 14:57:19 +03:00
ViacheslavKlimov
f23061a9ae Fix notification deduplication service (ConcurrentModificationException for deduplicationDurations map) 2024-05-06 12:22:26 +03:00
Oleksandra Matviienko
63df92e995 JUnit5 migration in common. Junit-platform.properties and logback-test.xml where added to java resource directories if needed.
Signed-off-by: Oleksandra Matviienko <al.zzzeebra@gmail.com>
2024-04-26 23:55:17 +02:00
ViacheslavKlimov
327503fd0a Await all housekeeper tasks to be processed in tests 2024-04-25 12:03:12 +03:00
ViacheslavKlimov
0361d34767 Minor refactoring 2024-04-16 14:01:11 +03:00
ViacheslavKlimov
881a8048ce Fix EntityDaoRegistry init 2024-04-15 12:34:16 +03:00
ViacheslavKlimov
0b18de1482 Refactor entities deletion 2024-04-12 15:32:07 +03:00
ViacheslavKlimov
49a76cad5a Housekeeper: disabled task types; refactoring 2024-04-11 11:53:32 +03:00
ViacheslavKlimov
00f8fd2c35 Merge remote-tracking branch 'origin/master' into feature/housekeeper 2024-04-09 12:08:53 +03:00
dashevchenko
11b8d3c41e added global queue prefix for pubsub queue factory 2024-03-22 13:06:58 +02:00
ViacheslavKlimov
be3e78044c Merge remote-tracking branch 'origin/master' into feature/housekeeper 2024-03-21 11:52:07 +02:00
ViacheslavKlimov
47cfebe2a7 Use QueueConsumerManager for other consumers 2024-03-20 13:25:30 +02:00
ViacheslavKlimov
e4cbbb0c5d Merge branch 'master' into feature/parallel-core-consumer
# Conflicts:
#	application/src/main/java/org/thingsboard/server/service/queue/DefaultTbCoreConsumerService.java
#	application/src/main/java/org/thingsboard/server/service/queue/DefaultTbRuleEngineConsumerService.java
#	application/src/main/java/org/thingsboard/server/service/queue/processing/AbstractConsumerService.java
2024-03-20 12:26:41 +02:00
ViacheslavKlimov
4ed952a9d6 Merge branch 'master' into develop/3.7 2024-03-19 15:44:23 +02:00
ViacheslavKlimov
8636ed3b0d TB Core consumer - parallel processing; refactoring 2024-03-19 12:57:37 +02:00
ViacheslavKlimov
b0d4faf798 Fix transactional calls in TransactionalEventListener 2024-03-16 15:49:40 +02:00
ViacheslavKlimov
22f5573e8d Housekeeper client for all service types 2024-03-13 19:59:13 +02:00
ViacheslavKlimov
0d3c3d6b25 Housekeeper: tests and refactoring 2024-03-13 14:09:05 +02:00
ViacheslavKlimov
b72af4ead9 Housekeeper tasks encoded to json 2024-02-21 18:49:15 +02:00
ViacheslavKlimov
69ead8cc47 Merge branch 'master' into feature/housekeeper
# Conflicts:
#	dao/src/main/java/org/thingsboard/server/dao/sql/user/JpaUserSettingsDao.java
#	dao/src/main/java/org/thingsboard/server/dao/sql/user/UserSettingsRepository.java
#	dao/src/main/java/org/thingsboard/server/dao/tenant/TenantServiceImpl.java
#	dao/src/main/java/org/thingsboard/server/dao/user/UserServiceImpl.java
#	dao/src/main/java/org/thingsboard/server/dao/user/UserSettingsDao.java
2024-02-20 18:53:13 +02:00
ViacheslavKlimov
721854c879 Housekeeper: reprocessing improvements 2024-02-20 18:50:29 +02:00
Andrew Shvayka
7ec87494f9
Merge pull request #10185 from thingsboard/fix/consumer-group-prefix
Added global queue prefix to js-executor, rule-node and tb-rule-engine-notifications-node- consumer group id
2024-02-16 16:32:17 +02:00
Andrew Shvayka
1894a16bea
Merge pull request #10157 from thingsboard/fix/rule-node-repartition
Improve actors init and repartitioning
2024-02-16 15:59:38 +02:00
Andrii Shvaika
45443d98fc Rewrite for clarity 2024-02-16 15:57:50 +02:00
Andrew Shvayka
d5da538e09
Merge pull request #9030 from dskarzh/feature/device-state-node
Device state rule node; device state service improvements
2024-02-16 12:18:39 +02:00
ViacheslavKlimov
7e07771acc Housekeeper tasks reprocessing 2024-02-14 20:20:08 +02:00
Alexander Keidel
005d555bc5 Global Queue Prefix is now correctly respected by js-executor, rule-node and tb-rule-engine-notifications-node- consumer groups 2024-02-14 13:25:13 +02:00
ViacheslavKlimov
91d6cf6dee Non-isolated tenant is not managed even if assignedTenantProfiles contains his profile 2024-02-13 13:50:41 +02:00
ViacheslavKlimov
492dc5916e Improvements for tenant actors init with dedicated rule engines 2024-02-13 11:07:34 +02:00
Igor Kulikov
2fb9b74bae Fix conflicts 2024-02-12 14:30:38 +02:00
ViacheslavKlimov
ba5c59f9d5 Merge branch 'master' into fix/rule-node-repartition
# Conflicts:
#	application/src/main/java/org/thingsboard/server/service/queue/DefaultTbClusterService.java
2024-02-12 11:13:03 +02:00
ViacheslavKlimov
c1f16769f4 Fix partition change event ignored 2024-02-09 14:15:24 +02:00
ViacheslavKlimov
55dc23b9ff Merge with hotfix/3.6.2 2024-02-09 11:38:40 +02:00
ViacheslavKlimov
e5311984bb Housekeeper API 2024-02-07 15:24:40 +02:00
YevhenBondarenko
d2961e39e7 merge with master 2024-02-06 22:40:27 +01:00
Dmytro Skarzhynets
f5a7fe73ab Merge branch 'master' into feature/device-state-node 2024-02-06 14:11:57 +02:00
ViacheslavKlimov
1f50a8c3ad Merge branch 'hotfix/3.6.2' into fix/actors-init
# Conflicts:
#	common/queue/src/main/java/org/thingsboard/server/queue/discovery/HashPartitionService.java
2024-01-31 13:39:43 +02:00
dashevchenko
8c41935c70 merged with master 2024-01-31 13:27:32 +02:00
Andrew Shvayka
34fa9fe035
Merge pull request #10102 from thingsboard/hotfix/3.6.2
Hotfix/3.6.2 sync up
2024-01-31 13:15:34 +02:00
dashevchenko
ce9351ba27 deleted unused classes 2024-01-30 18:20:23 +02:00
ViacheslavKlimov
5875a40118 Error handling for PartitionChangeEvent listeners 2024-01-30 15:16:53 +02:00
ViacheslavKlimov
2f73512005 Don't remove from myPartitions on queue update 2024-01-25 15:47:26 +02:00
ViacheslavKlimov
27f448a543 Improve partition service logs 2024-01-25 12:04:18 +02:00
ViacheslavKlimov
a571153b7c Single update message for multiple queues 2024-01-24 18:08:01 +02:00