Features

• Add cache hit or miss metrics
• Add coorindator specific terraform parameters
• Add data loading prefix allowlist parameter
• Add default PAS UDF
• Add E2E latency for GetKeyValues and GetKeyValueSet in sharded lookup
• Add file groups and file group reader logic
• Add go fmt to pre-commit
• Add key prefix support to blob storage client
• Add LogContext and ConsentedDebugConfiguration proto to v2 API and internal lookup API
• Add prod and nonprod build flag
• Add request context to wrap metrics context
• Add support for configuring directory allowlist
• Add wiring for prefix allowlist (actual impl in follow up cl)
• Allow overrides for coordinators endpoints in nonprod mode
• Allow to disable v1 key not found entry in response
• Create separate metrics context map for internal lookup server
• Deprecate metrics recorder for internal lookup
• Deprecate metrics recorder for internal server
• Deprecate metrics recorder for sharded lookup
• deprecate metrics recorder for V1 server and handler
• Deprecate metrics recorder from cache
• Enable simulation system send realtime udpates
• Enable TCMalloc for KV Server and benchmarks
• Explicitly enable core dumps
• Implement deletion cutoff max timestamp per directory
• Load data files and allow notifications from configured prefix
• Load prefix files on startup and handle prefix blob notifications
• Log common request metrics
• Migrate from glog to absl log
• Partition data loading metrics by delta file name
• Pass request context from hooks to downstream components
• Pass request context to udf hooks
• Read telemetry config from cloud parameter
• Revamp AWS metrics dashboard
• Revamp GCP metrics dashboard
• Set udf_min_log_level from parameter store.
• Support content type proto for v2 api
• Support content type proto for v2 api response
• Update cache interface and blob data location to pass prefix
• Update start_after to use a map from prefix to start_after
• Use file groups for loading snapshots
• Write logs to an Otel endpoint

Bug Fixes

• Actually load all files in a snapshot file group
• AWS: Filter out unavailable zones.
• Correct an error in kokoro_release.
• Correct format for image tag.
• Correct typo for internal dev's service_mesh_address.
• Correct typos in GCP deployment guide.
• Crash server if default UDF fails to load.
• Delete non-active certificate before creating a new one.
• Fix filtering logic for prefixed blobs
• Fix permissions for data-loading-blob-prefix-allowlist
• Make GCP nat optional.
• Parse delta filename from notification before validating it
• Remove glog dependency for record_utils
• Remove temp dir only if it's successfully created.
• Rename class to ThreadManager
• Set retain_initial_value_of_delta_metric flag for aws metrics exporter
• Update a outdated hyperlink.
• Update common repo to pick up the AWS metrics dimension fix
• Update GCP Terraform with ability to delete unhealthy instance.
• Update tf variables to use gorekore instead of kelvingorekore
• Use blob key instead of prefixed basename

GCP: Fixes

• GCP: Make sure server is connected to otel collector before reaching to ready state

GCP: Features

• GCP: Applying Terraform pulls docker image with new tag.
• GCP: Make service mesh address configurable.
• GCP: Make subnet ip cidr configurable.
• GCP: Make xlb/envoy optional.

Documentation

• Add ad retrieval explainer.
• Add docs for directory support
• Add PA and PAS folders
• Add PAS developer guide
• Add public docs for file groups
• Ads retreival explainer update.

Dependencies

• deps: Add clang-tidy bazel config
• deps: Add cpp_nowarn bazel config
• deps: Upgrade bazel to 6.5.0
• deps: Upgrade build-system to 0.55.1
• deps: Upgrade build-system to 0.55.2
• deps: Upgrade build-system to 0.57.0
• deps: Upgrade data-plane-shared repo
• deps: Upgrade data-plane-shared repo to 1684674 2024-02-09
• deps: Upgrade data-plane-shared-libraries to 1fbac46
• deps: Upgrade pre-commit hooks

Bug: N/A