Skip to content

Releases: karafka/karafka-web

v0.7.5

29 Sep 10:09
d274ab4
Compare
Choose a tag to compare
  • [Enhancement] Update order of topics creation for the setup of Web to support zero-downtime setup of Web in running Karafka projects.
  • [Enhancement] Add space delimiter to counters numbers to make them look better.
  • [Improvement] Normalize per-process job tables and health tables structure (topic name on top).
  • [Fix] Fix a case where charts aggregated data would not include all topics.
  • [Fix] Make sure, that most recent per partition data for Health is never overwritten by an old state from a previous partition owner.
  • [Fix] Cache assets for 1 year instead of 7 days.
  • [Fix] Remove source maps pointing to non-existing locations.
  • [Maintenance] Include license and copyright notice for timeago.js that was missing in the JS min file.

v0.7.4

19 Sep 10:09
6862904
Compare
Choose a tag to compare
  • [Improvement] Skip aggregations on older schemas during upgrades. This only skips process-reports (that are going to be rolled) on the 5s window in case of an upgrade that should not be a rolling one anyhow. This simplifies the operations and minimizes the risk on breaking upgrades.
  • [Fix] Fix not working ps for macOS.

v0.7.3

18 Sep 19:47
d857b38
Compare
Choose a tag to compare
  • [Improvement] Mitigate a case where a race-condition during upgrade would crash data.

v0.7.2

18 Sep 19:47
43f6d25
Compare
Choose a tag to compare
  • [Improvement] Display hidden by accident errors for OSS metrics.
  • [Improvement] Use a five second cache for non-production environments to improve dev experience.
  • [Improvement] Limit number of partitions listed on the Consumers view if they exceed 10 to improve readability and indicate, that there are more in OSS similar to Pro.
  • [Improvement] Squash processes reports based on the key instead of payload skipping deserialization for duplicated reports.
  • [Improvement] Make sure, that the Karafka topics present data can be deserialized and report on the status page if not.
  • [Fix] Extensive data-poll on processes despite no processes being available.

v0.7.1

18 Sep 19:46
e666eaa
Compare
Choose a tag to compare
  • [Improvement] Limit number of partitions listed on the Consumers view if they exceed 10 to improve readability and indicate, that there are more in Pro.
  • [Improvement] Make sure, that small messages size (less than 100 bytes) is correctly displayed.
  • [Fix] Validate refresh time.
  • [Fix] Fix invalid message payload size display (KB instead of B, etc).

v0.7.0

14 Sep 14:03
925fe15
Compare
Choose a tag to compare
  • [Feature] Introduce graphs.
  • [Feature] Introduce historical metrics storage.
  • [Feature] Introduce per-topic data exploration in the Explorer.
  • [Feature] Introduce per-topic and per-partition most recent message view with live reload.
  • [Feature] Introduce a new per-process inspection view called "Details" ti display all process real-time aggregated data.
  • [Feature] Introduce bundle exec karafka-web migrate that can be used to bootstrap the proper topics and initial data in environments where Karafka Web-UI should be used but is missing the initial setup.
  • [Feature] Replace decrypt with a pluggable API for deciding which topics data to display.
  • [Feature] Make sure, that the karafka server process that is materializing UI states is not processing any data having unsupported (newer) schemas. This state will be also visible in the status page.
  • [Feature] Provide ability to reproduce a given message to the same topic partition with all the details from the per message explorer view.
  • [Feature] Provide "surrounding" navigation link that allows to view the given message in the context of its surrounding. Useful for debugging of failures where the batch context may be relevant.
  • [Feature] Allow for time based lookups per topic partition.
  • [Feature] Introduce Offsets Health inspection view for frozen LSO lookups with lso_threshold configuration option.
  • [Improvement] Support pattern subscriptions details in the routing view both by displaying the pattern as well as expanded routing details.
  • [Improvement] Collect total number of threads per process for the process details view.
  • [Improvement] Normalize naming of metrics to better reflect what they do (in reports and in the Web UI).
  • [Improvement] Link error reported first and last offset to the explorer.
  • [Improvement] Expand routing details to compensate for nested values in declarative topics.
  • [Improvement] Include last rebalance age in the health view per consumer group.
  • [Improvement] Provide previous / next navigation when viewing particular messages in the explorer.
  • [Improvement] Provide previous / next navigation when viewing particular errors.
  • [Improvement] Link all explorable offsets to the explorer.
  • [Improvement] Extend status page checks to ensure, that it detects a case when Web-UI is not part of karafka.rb but still referenced in routes.
  • [Improvement] Extend status page checks to ensure, that it detects a case where there is no initial consumers metrics in Kafka topic.
  • [Improvement] Report Rails version when viewing status page (if Rails used).
  • [Improvement] List Web UI topics names on the status page in the info section.
  • [Improvement] Start versioning the materialized states schemas.
  • [Improvement] Drastically improve the consumers view performance.
  • [Improvement] Ship versioned assets to prevent invalid assets loading due to cache.
  • [Improvement] Use Cache-Control to cache all the static assets.
  • [Improvement] Link counters counter to jobs page.
  • [Improvement] Include a sticky footer with the most important links and copyrights.
  • [Improvement] Store lag in counters for performance improvement and historical metrics.
  • [Improvement] Introduce in-memory cluster state cached to improve performance.
  • [Improvement] Switch to offset based pagination instead of per-page pagination.
  • [Improvement] Avoid double-reading of watermark offsets for explorer and errors display.
  • [Improvement] When no params needed for a page, do not include empty params.
  • [Improvement] Do not include page when page is 1 in the url.
  • [Improvement] Align descriptions for the status page, to reflect that state check happens for consumers initial state.
  • [Improvement] Report bytesize of raw payload when viewing message in the explorer.
  • [Improvement] Use zlib compression for Karafka Web UI topics reports (all). Reduces space needed from 50 to 91%.
  • [Improvement] Rename lag to lag stored in counters to reflect what it does.
  • [Improvement] Collect both stored lag and lag.
  • [Improvement] Introduce states and metrics schema validation.
  • [Improvement] Prevent locking in sampler for time of OS data aggregation.
  • [Improvement] Collect and report number of messages in particular jobs.
  • [Improvement] Limit segment size for Web topics to ensure, that Web-UI does not drain resources.
  • [Improvement] Introduce cookie based sessions management for future usage.
  • [Improvement] Introduce config validation.
  • [Improvement] Provide flash messages support.
  • [Improvement] Use replication factor of two by default (if not overridden) for Web UI topics when there is more than one broker.
  • [Improvement] Show a warning when replication factor of 1 is used for Web UI topics in production.
  • [Improvement] Collect extra additional metrics useful for hanging transactions detection.
  • [Improvement] Reorganize how the Health view looks.
  • [Improvement] Hide all private Kafka topics by default in the explorer. Configurable with show_internal_topics config setting.
  • [Fix] Return 402 status instead of 500 on Pro features that are not available in OSS.
  • [Fix] Fix a case where errors would not be visible without Rails due to the String#first usage.
  • [Fix] Fix a case where live-poll would be disabled but would still update data.
  • [Fix] Fix a case where states materializing consumer would update state too often.
  • [Fix] Fix a bug when rapid non-initialized shutdown could mess up the metrics.
  • [Fix] Fix a case where upon multiple rebalances, part of the states materialization could be lost.
  • [Fix] Make sure, that the flushing interval computation division happens with float.
  • [Fix] Fix a case where app client id change could force web-ui to recompute the metrics.
  • [Fix] Make sure, that when re-using same Karafka Web-UI topics as a different up, all states and reports are not recomputed back.
  • [Fix] Fix headers size inconsistency between Health and Routing.
  • [Fix] Fix invalid padding on status page.
  • [Fix] Fix a case where root mounted Karafka Web-UI would not work.
  • [Fix] Fix a case where upon hitting a too high page of consumers we would inform that no consumers are reporting instead of information that this page does not contain any reporting.
  • [Refactor] Limit usage of UI models for data intense computation to speed up states materialization under load.
  • [Refactor] Reorganize pagination engine to support offset based pagination.
  • [Refactor] Use Roda custom_block_results plugin for controllers results handling.
  • [Maintenance] Require karafka 2.2.0 due to fixes in the Iterator API and routing API extensions.

v0.6.3

22 Jul 10:51
cbe0376
Compare
Choose a tag to compare

[Fix] Remove files from 0.7.0 accidentally added to the release.

v0.6.2

22 Jul 10:50
cbe0376
Compare
Choose a tag to compare
  • [Fix] Fix extensive CPU usage when using HPET clock instead of TSC due to interrupt frequency.

v0.6.1

25 Jun 09:51
78a2779
Compare
Choose a tag to compare
  • [Improvement] Include the karafka-web version in the status page tags.
  • [Improvement] Report karafka-web version that is running in particular processes.
  • [Improvement] Display karafka-web version in the per-process view.
  • [Improvement] Report in the web-ui a scenario, where getting cluster info takes more than 500ms as a warning to make people realize, that operating with Kafka with extensive latencies is not recommended.
  • [Improvement] Continue the status assessment flow on warnings.
  • [Fix] Do not recommend running a server as a way to bootstrap the initial state.
  • [Fix] Ensure in the report contract, that karafka-core, karafka-web, rdkafka and librdkafka are validated.

v0.6.0

13 Jun 14:09
ca26727
Compare
Choose a tag to compare
  • [Feature] Introduce producers errors tracking.
  • [Improvement] Display the error origin as a badge to align with consumers view topic assignments.
  • [Improvement] Collect more job metrics for future usage.
  • [Improvement] Normalize order of job columns on multiple views.
  • [Improvement] Improve pagination by providing a "Go to first page" fast button.
  • [Improvement] Provide more explicit info in the consumers view when no consumers running.
  • [Improvement] Validate error reporting with unified error contract.
  • [Improvement] Use estimated errors count for counters presentation taken from the errors topic instead of materialization via consumers states to allow for producers errors tracking.
  • [Improvement] Introduce schema_version to error reports.
  • [Improvement] Do not display the dispatched error message offset in the breadcrumb and title as it was confused with the error message content.
  • [Improvement] Display error_class value wrapped with code tag.
  • [Improvement] Display error type value wrapped with label tag.
  • [Improvement] Include a blurred backtrace for non-Pro error inspection as a form of indication of this Pro feature.
  • [Fix] Fix invalid arrows style in the pagination.
  • [Fix] Fix missing empty Process name value in the errors index view.
  • [Fix] Fix potential empty dispatch of consumer metrics.
  • [Fix] Remove confusing part about real time resources from the "Pro feature" page.
  • [Refactor] Cleanup common components for errors extraction.
  • [Refactor] Remove not used and redundant partials.
  • [Maintenance] Require karafka 2.1.4 due to fixes in metrics usage for workless flows.