Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
235 commits
Select commit Hold shift + click to select a range
f29bc15
Add topic configuration and fix config types
milindl Nov 28, 2023
1b20ce6
Add errors for promisified API
milindl Nov 27, 2023
446dee1
Convert delivery report error from string to code for richer error
milindl Nov 29, 2023
15755c1
Add error types to producer, and fix some errors
milindl Nov 30, 2023
9f5c734
Add consumer errors and clean up consumer code
milindl Dec 1, 2023
6a3f5ce
Exhaustive config compability
milindl Dec 3, 2023
7837ac4
Add experimental admin client and example
milindl Dec 4, 2023
8d2daeb
Allow topic config properties to be set with the global config [c++]
milindl Dec 9, 2023
d1c30f4
Add first test for promisified API: consumer.
milindl Dec 9, 2023
85b1341
Add tests for consumer.seek()
milindl Dec 11, 2023
818ce7b
Add tests for consumer.pause() and consumer.resume()
milindl Dec 12, 2023
184e124
Add test for consumer.run().
milindl Dec 12, 2023
daa572b
Make subscriptions replaceable with flag
milindl Dec 12, 2023
11aa5e4
Add producer tests and changes
milindl Dec 12, 2023
0b43e52
Add semaphore block to project (#5)
milindl Nov 30, 2023
4493422
chore: update repo by service bot (#6)
ConfluentJenkins Nov 30, 2023
5470c70
Set up basic semaphore
milindl Nov 30, 2023
9b3bdd5
macOS - basic changes
milindl Nov 30, 2023
af6e124
Try adding packaging flow
milindl Dec 1, 2023
256cea7
Everything, all at once
milindl Dec 5, 2023
17b06e2
Add logger support to configuration
milindl Dec 13, 2023
de06e49
Merge branch 'master' into dev_producer_testing_and_fixes
milindl Dec 13, 2023
10c63e2
Merge branch 'dev_producer_testing_and_fixes' into feature/add-basic-…
milindl Dec 13, 2023
99ca4ec
Bump version
milindl Dec 13, 2023
9428b67
Add quality-of-life improvements to error messages and improve config…
milindl Dec 14, 2023
51a8bfa
Merge branch 'dev_config_qol_fixes' into dev_producer_testing_and_fixes
milindl Dec 14, 2023
96add1b
Bump version
milindl Dec 13, 2023
a92ae58
Remove -j flag
milindl Dec 14, 2023
625f3b1
Revert module name changes
milindl Dec 14, 2023
9d91a32
Change gypfiles
milindl Dec 14, 2023
a5f1f4a
Just remove rpath
milindl Dec 14, 2023
fd2b46d
Change path, temporarily
milindl Dec 14, 2023
d40e326
Merge branch 'dev_config_qol_fixes' into feature/add-basic-semaphore-…
milindl Dec 14, 2023
00a4d03
Use single condition in gyp and
emasab Dec 14, 2023
3aaf9e5
Merge branch 'dev_producer_testing_and_fixes' into dev_early_access_d…
milindl Dec 14, 2023
3f89fe5
Merge branch 'feature/add-basic-semaphore-setup' into dev_early_acces…
milindl Dec 14, 2023
acb40a3
Improve MIGRATION.md, add licensing, start changing README.md
milindl Dec 14, 2023
44db29c
Update license and add missing error
milindl Dec 14, 2023
1fe9143
Add changes for 0.1.4-devel release
milindl Dec 15, 2023
d4f671f
Fix merge issue in conflict, update security dependency
milindl Dec 15, 2023
a5cbdfd
Remove insecure dependency and add promisified API to docs
milindl Dec 15, 2023
e5f216d
Add functional changes for kafkaJs block
milindl Dec 20, 2023
25eec75
Documentation changes for kakfaJs: block
milindl Dec 26, 2023
1b6d4bf
Update examples for kafkaJs: block
milindl Dec 26, 2023
27245a7
Update Admin Client for config changes
milindl Dec 26, 2023
94bec0a
Add alpine builds for releases for Linux arm64 and amd64
milindl Dec 26, 2023
b1736cc
Fix producer tests after kafkaJs: block addition
milindl Dec 27, 2023
a825fc0
Fix consumer tests after kafkaJs: block addition
milindl Dec 27, 2023
4a91af2
Add eslint changes
milindl Dec 27, 2023
32681e3
Separate promisified tests as they're all e2e
milindl Dec 27, 2023
962defb
Fix consumeMessages test and add TEST_DEBUG env var
milindl Dec 28, 2023
b7fd389
Add async lock for consume/disconnect
milindl Jan 8, 2024
2dd25d8
Add quickstart
milindl Jan 8, 2024
4c7be5c
Add examples for fresh users of library
milindl Jan 8, 2024
aa91dbe
Copy config rather than modifying it so that same Kafka object can be…
milindl Jan 9, 2024
c4057d3
Add simpler consume() function besides run() and update example
milindl Jan 9, 2024
6dad27b
Create empty changelog file
milindl Jan 9, 2024
6861eaf
Update CONTRIBUTING.md and lint checks
milindl Jan 9, 2024
6f58942
Bump version
milindl Jan 9, 2024
c579692
Update agent to newer macOS version
milindl Jan 9, 2024
8c0a748
Bump version in README.md and package-lock
milindl Jan 10, 2024
384cd9a
Update CHANGELOG.md
milindl Jan 11, 2024
a8b3590
Merge branch 'master' into dev_early_access_development_branch
milindl Jan 16, 2024
a6267af
Create SECURITY.md
milindl Jan 16, 2024
224860f
Fix warning about retries being set in consumer
milindl Jan 17, 2024
c9e062c
Update CONTRIBUTING.md
milindl Jan 17, 2024
265c2ce
Update QUICKSTART.md
milindl Jan 17, 2024
2f8f7fe
Change kafkaJs -> kafkaJS for uniformity
milindl Jan 17, 2024
834dee3
Add schema registry example
milindl Jan 18, 2024
6ba9e02
Update CONTRIBUTING.md, and move in-depth reference into INTRODUCTION.md
milindl Jan 18, 2024
58c3449
Update sr.js (#22)
nhaq-confluent Jan 21, 2024
9fb2203
Change fromBeginning in sr.js example
milindl Jan 22, 2024
c56f068
Make packaging flow easier
milindl Jan 22, 2024
d7421ac
Bump version
milindl Jan 22, 2024
3bd3969
Update README.md (#23)
nhaq-confluent Jan 22, 2024
b1036e0
Bump version
milindl Jan 22, 2024
92a6fdc
Poll producer in send() loops
milindl Jan 24, 2024
a62ca53
Change name internally
milindl Jan 30, 2024
dfe5a98
Version bump for release
milindl Jan 30, 2024
1b035c2
Add consumer message cache for KafkaJS compability mode
milindl Feb 1, 2024
ea487f9
Add tests for cache and non-compatibility mode
milindl Feb 1, 2024
6e49c46
Add some checks for kafkaJS compability mode
milindl Feb 2, 2024
fa65e50
Add parametrization to tests for auto commit
milindl Feb 2, 2024
80d552d
Add client software name and version
milindl Feb 2, 2024
905ff9e
Don't modify globalConf while creating client.
milindl Feb 2, 2024
6ad531d
Remove kafkaJsCompatibilityMode variable and assume true
milindl Feb 6, 2024
40119c6
Add setSaslCredentials for producer
milindl Feb 12, 2024
64cba18
Add Producer flush
milindl Feb 13, 2024
3e36c0b
Add cooperative rebalancing
milindl Feb 14, 2024
755dafb
Add windows package build
milindl Feb 14, 2024
d921875
Add tests for incremental rebalancing
milindl Feb 16, 2024
a985041
Update README.md (#24)
nhaq-confluent Feb 16, 2024
924d0d3
Add copyright notices and change imports
milindl Feb 16, 2024
6e199ac
Don't run windows pipeline needlessly
milindl Feb 16, 2024
10f5a0c
Revert changes to examples
milindl Feb 16, 2024
c1f2906
Fix certain consumer examples
milindl Feb 16, 2024
4db6a6f
Add exemption for version checks from devel releases
milindl Feb 16, 2024
81b75dc
Version bump to v0.1.10-devel
milindl Feb 16, 2024
96d7e3d
Update dependency information
milindl Feb 19, 2024
00f927a
Update versioning and librdkafka repo URL
milindl Feb 19, 2024
1890c13
Add CHANGELOG.md for v0.1.10-devel
milindl Feb 19, 2024
1cef0f3
Bump package.json version after release
milindl Feb 19, 2024
2e5f34f
Add confluent-cloud examples
milindl Feb 19, 2024
76bc8ca
Delete LICENCE.node-rdkafka-txt (#30)
maxwlang Feb 22, 2024
a6cc7a8
Add eachBatch API compability
milindl Mar 5, 2024
fc907bd
Add static membership test
milindl Mar 6, 2024
a347f7e
Skip consumer test which uses events
milindl Mar 15, 2024
7960d77
Add ListGroups to admin client
milindl Mar 15, 2024
9e3aa35
Update package-lock.json
milindl Mar 15, 2024
1777f4d
Update copyright headers
milindl Mar 15, 2024
3ea556c
Add AdminAPI for describeGroups
milindl Mar 22, 2024
a69206d
Add AdminAPI for deleteGroups
milindl Mar 22, 2024
3162625
Version bump to 0.1.11-devel
milindl Mar 22, 2024
419d47f
Changes in package-lock.json due to updates
milindl Mar 26, 2024
d6a9638
Add AdminAPI for listTopics
milindl Mar 26, 2024
ae6525d
Make AdminClient inherit from Client
milindl Apr 2, 2024
98c78e7
Fix aliasing bug between NodeKafka::Conf and ConfImpl
milindl Apr 2, 2024
0629955
Fix issue with cooperative assignor when rebalance_cb is a boolean
milindl Apr 2, 2024
85e60d8
Fix memory leak: dispatcher async handle
milindl Apr 4, 2024
fd13955
Fix memory leak: ConfImpl within Conf
milindl Apr 4, 2024
34e4bd3
Add OAUTHBEARER token refresh callback
milindl Apr 5, 2024
9476060
Add examples and tests for non-promisified OAUTHBEARER token refresh …
milindl Apr 5, 2024
127567f
Allow token refresh cb to be an async function
milindl Apr 5, 2024
510584b
Add OAUTHBEARER support to promisified API
milindl Apr 8, 2024
e11fcfb
Add examples and tests for OAUTHBEARER (promisified API)
milindl Apr 8, 2024
82fce55
Make examples a sub-package to fix the imports
milindl Apr 8, 2024
c793ae9
Fix types and add typescript examples
milindl Apr 9, 2024
5bc9ce9
Bump version for 0.1.12-devel
milindl Apr 9, 2024
fe26fed
Add docker login step to CI
milindl Apr 9, 2024
56bf6ab
Update release binary download path
milindl Apr 10, 2024
9a7530d
Update QUICKSTART.md to reflect removed consume() API
milindl Apr 17, 2024
9989ae3
chore: update repo semaphore project (#21)
ConfluentJenkins Apr 18, 2024
dccab40
Update service.yaml for repository name
milindl Apr 19, 2024
6118b66
fix: memory leak in incremental assign (#35)
martijnimhoff Apr 22, 2024
08ecfc3
Add optimization where the size of messages in our subscription is le…
milindl Apr 23, 2024
ed7226b
Add example to measure performance
milindl Apr 23, 2024
938df93
Add storeOffsets and fix typings
milindl Apr 25, 2024
788a972
Update comments and fix small issues
milindl May 6, 2024
d9958cf
Reconcile createTopics type and behaviour
milindl May 6, 2024
eb30bde
Reconcile types and MIGRATION.md with library
milindl May 6, 2024
9cd609b
Run integration tests on semaphore
milindl May 7, 2024
62a2bc5
Bump version to 0.1.13-devel
milindl May 7, 2024
a036bc3
Increase available memory for tests
milindl May 8, 2024
8fe9107
Increase available time for tests
milindl May 8, 2024
178d395
Add metadata to offset commits
milindl May 10, 2024
bda98c6
Add types for logger and loglevel to configs
milindl May 13, 2024
357cdb3
Add Producer poll from librdkafka background thread
milindl May 15, 2024
3f9f7fa
Enable optimization for less-than-cache-size messages in consumer
milindl May 16, 2024
35e893c
Fix issues with header conversions
milindl May 17, 2024
9612dff
Bump version to 0.1.14-devel
milindl May 17, 2024
618d6bf
Add latest node version and update librdkafka on each build
milindl May 17, 2024
7bf9da6
Bump version to 0.1.15-devel
milindl May 17, 2024
9e803e0
Add committed() and metadata storage to commit/store for promisified API
milindl May 20, 2024
c4a4e25
Add leaderEpoch fields to toppars
milindl May 21, 2024
39bd9f9
Add data-governance to code owners for schema registry clients (#52)
emasab Jun 4, 2024
d147944
Fix deprecation warning
milindl Jun 5, 2024
82b57d5
Separate eachMessage and eachBatch internal consume loop
milindl Jun 5, 2024
16d9547
Update performance example with more cases
milindl Jun 10, 2024
9d3130f
Add per-partition cache with global expiry
milindl Jun 10, 2024
a728b4a
Add per-partition cache expiry logic
milindl Jun 12, 2024
28d2253
Allow cache to disburse multiple messages at once
milindl Jun 13, 2024
4ea26f0
Add per-partition concurrency
milindl Jun 17, 2024
b140a48
Add partition level concurrency to faux-eachBatch
milindl Jun 17, 2024
f2ec063
Create persistent workers for per-partition concurrency, prevents exc…
milindl Jun 20, 2024
85f9b7e
Fix tests for Per Partition Concurrency
milindl Jun 24, 2024
9a2f9c4
Add message set capability to message cache
milindl Jun 25, 2024
2f4bd76
Add naive batching (without resolution handling)
milindl Jul 1, 2024
b2b546a
Add batch staleness, resolution, and offset management to eachBatch
milindl Jul 2, 2024
0848e7f
Update tests for true eachBatch
milindl Jul 2, 2024
ca1e002
Remove debug-only properties
milindl Jul 8, 2024
717ec67
Update MIGRATION.md for eachBatch
milindl Jul 8, 2024
d776115
Bump version
milindl Jul 8, 2024
1d9533b
Fix linting and Makefile issues (#2)
milindl Aug 6, 2024
72c7e20
Add SchemaRegistryClient, RestService, and testing (#1)
Claimundefine Aug 8, 2024
2887c2c
Add mock client for testing
Claimundefine Aug 9, 2024
2858954
Remove testing artifacts
Claimundefine Aug 9, 2024
267d103
Fix flaky e2e tests (#54)
PratRanj07 Aug 12, 2024
c3aea94
Merge branch 'airlock/dev_early_access_development_branch' into mock-…
Claimundefine Aug 12, 2024
a903b6e
Preset fix (#6)
Claimundefine Aug 13, 2024
c4a091d
Merge branch 'airlock/dev_early_access_development_branch' into mock-…
Claimundefine Aug 13, 2024
1be847f
Do not modify RegExps which don't start with a ^
milindl Aug 13, 2024
c4f3a43
Fix argument mutation in run, pause and resume
milindl Aug 14, 2024
4e9746f
Merge branch 'airlock/dev_early_access_development_branch' into mock-…
Claimundefine Aug 16, 2024
165ae41
Merge pull request #4 from confluentinc/mock-schemaregistry-client
rayokota Aug 18, 2024
4aee89f
Dekregistry client (#67)
Claimundefine Aug 19, 2024
d73496f
Add clientConfig, baseUrl retry, RestError, encodeURIComponent (#12) …
Claimundefine Aug 21, 2024
3333a2f
Update tsconfig.json (#69)
rayokota Aug 21, 2024
4748d8a
Fix broken tests (#70)
Claimundefine Aug 21, 2024
40fe41a
Add commitCb method (#59)
emasab Aug 22, 2024
579d326
Fix eslint config (#71)
rayokota Aug 22, 2024
9563d4a
Add eslint rules (#72)
rayokota Aug 22, 2024
56759d8
First cut at JavaScript serdes (#73)
rayokota Aug 23, 2024
2adc75e
Add assign/unassign within rebalance callbacks
milindl Aug 27, 2024
4f7b7da
Add performance benchmarking script modes and README
milindl Sep 11, 2024
de76f03
Add confluent debian repo for performance benchmark
milindl Sep 11, 2024
52a6ccb
Remove store from promisified API
milindl Aug 12, 2024
9bef0d8
Add binding level debug logging and client name to logs
milindl Sep 11, 2024
99d0c5e
Fix typo in script name
milindl Sep 11, 2024
a744a82
First cut at Data Contract rules (#77)
rayokota Sep 11, 2024
7e09cb7
Separate SR into a different workspace (#78)
rayokota Sep 12, 2024
f5e7f3e
Refactor to always use a barrier for pending operation (#26)
emasab Sep 13, 2024
65c601d
Schemaregistry rebase (#33) (#80)
Claimundefine Sep 13, 2024
2173850
Add Docker environment for integration tests (#34) (#81)
Claimundefine Sep 13, 2024
31abae4
Fix log level config in light of binding logs
milindl Sep 14, 2024
0d8400b
Remove consumerGroupId argument from sendOffsets and add tests (#82)
milindl Sep 14, 2024
8ce7cfb
Performance measurement improvements
emasab Sep 15, 2024
d014984
Admin examples for available APIs (#84)
emasab Sep 15, 2024
8b6521c
Fix listGroups segfault when passing an undefined matchConsumerGroupS…
emasab Sep 16, 2024
59e1c06
Add more unit tests; minor fixes for KMS clients (#86)
rayokota Sep 16, 2024
7350d0a
Bump version to 0.1.17-devel
milindl Sep 17, 2024
0e48f63
Add complex encryption tests (#89)
rayokota Sep 17, 2024
4938194
Add index.ts (#91)
rayokota Sep 20, 2024
f97166f
Enhance HighLevelProducer to take schema serializers (#92)
rayokota Sep 20, 2024
e27aedb
Add auth features (#47) (#94)
Claimundefine Sep 20, 2024
5485bc8
Add more JSON Schema validation tests (#95)
rayokota Sep 20, 2024
96c8357
Move ts-jest to dev dependencies (#96)
rayokota Sep 20, 2024
5d0a580
Add JSON integration tests (#46) (#97)
Claimundefine Sep 22, 2024
434e23b
Unsubscribe before disconnecting to mitigate hangs on destroy (#98)
milindl Sep 24, 2024
0e7d7e7
Pass creds to DEK Registry client (#99)
rayokota Sep 24, 2024
c529f2e
Bump version to 0.2.0 and drop -devel (#100)
milindl Sep 25, 2024
73e8a17
Remove mandatory basic or bearer auth credentials (#57) (#101)
Claimundefine Sep 25, 2024
b8ead8b
Add build script and readme (#104)
rayokota Sep 26, 2024
c64b0da
Add license (#105)
rayokota Sep 26, 2024
ca3d380
Add clearLatestCaches/clearCaches API, fix test to call clearLatestCa…
rayokota Sep 26, 2024
28eac09
Add avro integration tests (#56) (#106)
Claimundefine Sep 27, 2024
bd4fad6
Add tsdoc (#107)
rayokota Sep 27, 2024
7d5d246
Enhance docs (#108)
rayokota Sep 27, 2024
4e3c715
Update schemaregistry README (#109)
rayokota Sep 28, 2024
790b5e2
Add restService interfaces to exported types (#110)
rayokota Sep 28, 2024
251a10a
Rename DekClient to avoid conflict with Client (#112)
rayokota Sep 30, 2024
6d5dbdf
Schemaregistry examples (#69) (#113)
Claimundefine Sep 30, 2024
e627f67
Add schemaregistry examples workspace with avro, json, and csfle exam…
Claimundefine Oct 1, 2024
b9be537
bugfix integ tests for registering -value (#71) (#115)
Claimundefine Oct 1, 2024
14eef59
Bump version to v0.2.1 (#116)
milindl Oct 3, 2024
49f6d5a
Update version to 0.2.1 for EA release (#72) (#117)
Claimundefine Oct 10, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/CODEOWNERS
Original file line number Diff line number Diff line change
@@ -1 +1 @@
* @confluentinc/clients
* @confluentinc/clients @confluentinc/data-governance
4 changes: 2 additions & 2 deletions .github/ISSUE_TEMPLATE/bug_report.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,11 +9,11 @@ about: Create a report to help us improve
- Node Version [e.g. 8.2.1]:
- NPM Version [e.g. 5.4.2]:
- C++ Toolchain [e.g. Visual Studio, llvm, g++]:
- confluent-kafka-js version [e.g. 2.3.3]:
- confluent-kafka-javascript version [e.g. 2.3.3]:

**Steps to Reproduce**

**confluent-kafka-js Configuration Settings**
**confluent-kafka-javascript Configuration Settings**


**Additional context**
2 changes: 1 addition & 1 deletion .github/workflows/npm-publish.yml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# This workflow will run tests using node and then publish a package to GitHub Packages when a release is created
# For more information see: https://help.github.com/actions/language-and-framework-guides/publishing-nodejs-packages

name: Publish confluent-kafka-js
name: Publish confluent-kafka-javascript

on:
release:
Expand Down
5 changes: 5 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,14 +1,19 @@
build/
dist/
node_modules/
deps/librdkafka
npm-debug.log

docs

examples/**/package-lock.json

deps/*
!deps/*.gyp
!deps/windows-install.*

.DS_Store

.idea
.vscode
coverage
2 changes: 1 addition & 1 deletion .gitmodules
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
[submodule "deps/librdkafka"]
path = deps/librdkafka
url = https://github.com/edenhill/librdkafka.git
url = https://github.com/confluentinc/librdkafka.git
1 change: 0 additions & 1 deletion .jshintignore

This file was deleted.

23 changes: 0 additions & 23 deletions .jshintrc

This file was deleted.

3 changes: 3 additions & 0 deletions .npmignore
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,9 @@ deps/*
.gitmodules
Dockerfile
deps/librdkafka/config.h
schemaregistry
schemaregistry-examples
build
.github
.vscode
.semaphore
10 changes: 10 additions & 0 deletions .semaphore/build-docker.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
#!/bin/sh
# This script is used to build the project within a docker image.
# The docker image is assumed to be an alpine docker image, for glibc based builds, we use
# the semaphhore agent directly.

apk add -U ca-certificates openssl ncurses coreutils python3 make gcc g++ libgcc linux-headers grep util-linux binutils findutils perl patch musl-dev bash
# /v is the volume mount point for the project root
cd /v
npm install
npx node-pre-gyp package
4 changes: 2 additions & 2 deletions .semaphore/project.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,12 +6,12 @@
apiVersion: v1alpha
kind: Project
metadata:
name: confluent-kafka-js
name: confluent-kafka-javascript
description: ""
spec:
visibility: private
repository:
url: [email protected]:confluentinc/confluent-kafka-js.git
url: [email protected]:confluentinc/confluent-kafka-javascript.git
run_on:
- branches
- tags
Expand Down
25 changes: 25 additions & 0 deletions .semaphore/project_public.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
# This file is managed by ServiceBot plugin - Semaphore. The content in this file is created using a common
# template and configurations in service.yml.
# Modifications in this file will be overwritten by generated content in the nightly run.
# For more information, please refer to the page:
# https://confluentinc.atlassian.net/wiki/spaces/Foundations/pages/2871296194/Add+SemaphoreCI
apiVersion: v1alpha
kind: Project
metadata:
name: confluent-kafka-javascript
description: ""
spec:
visibility: public
repository:
url: [email protected]:confluentinc/confluent-kafka-javascript.git
run_on:
- forked_pull_requests
pipeline_file: .semaphore/semaphore.yml
integration_type: github_app
status:
pipeline_files:
- path: .semaphore/semaphore.yml
level: pipeline
forked_pull_requests:
allowed_contributors:
- "ConfluentSemaphore"
Loading