DataHub Releases

Summary

Version	Release Date	Links
v0.10.4	2023-06-09	Release Notes, View on GitHub
v0.10.3	2023-05-25	Release Notes, View on GitHub
v0.10.2	2023-04-13	View on GitHub
v0.10.1	2023-03-23	View on GitHub
v0.10.0	2023-02-07	View on GitHub
v0.9.6.1	2023-01-31	View on GitHub
v0.9.6	2023-01-13	View on GitHub
v0.9.5	2022-12-23	View on GitHub
v0.9.4	2022-12-20	View on GitHub
v0.9.3	2022-11-30	View on GitHub
v0.9.2	2022-11-04	View on GitHub
v0.9.1	2022-10-31	View on GitHub
v0.9.0	2022-10-11	View on GitHub
v0.8.45	2022-09-23	View on GitHub
v0.8.44	2022-09-01	View on GitHub
v0.8.43	2022-08-09	View on GitHub
v0.8.42	2022-08-03	View on GitHub
v0.8.41	2022-07-15	View on GitHub
v0.8.40	2022-06-30	View on GitHub
v0.8.39	2022-06-24	View on GitHub
v0.8.38	2022-06-09	View on GitHub
v0.8.37	2022-06-09	View on GitHub
v0.8.36	2022-06-02	View on GitHub
v0.8.35	2022-05-18	View on GitHub
v0.8.34	2022-05-04	View on GitHub
v0.8.33	2022-04-15	View on GitHub
v0.8.32	2022-04-04	View on GitHub
v0.8.31	2022-03-17	View on GitHub
v0.8.30	2022-03-17	View on GitHub
v0.8.29	2022-03-10	View on GitHub

v0.10.4

Released on 2023-06-09 by @pedro93.

Release Highlights

User Experience

• You can now create and assign Custom Ownership types within DataHub; plus, we now display the owner type on an Entity Page <img width="336" alt="ownershiptype-displayed" src="https://github.com/datahub-project/datahub/assets/15873986/3bd84ef5-0860-4dfb-8670-b23857c6d6e0">

• Various bug fixes to Column Level Lineage visualization

Metadata ingestion

• You can now define column-level lineage (aka fine-grained lineage) via our file-based lineage source
• Looker: Ingest Looks that are not part of a Dashboard
• Glue: Error reporting now includes lineage failures
• BigQuery: Now support deduplicating LogEntries based on insertId, timestamp, and logName

Docs

• CSV Enricher: improvements to sample CSV and recipe
• Guide for changing default DataHub credentials
• Updated guide to apply time-based filters on Lineage

What's Changed

• ci(ingest/kafka): improve kafka integration test reliability by @hsheth2 in https://github.com/datahub-project/datahub/pull/8085
• fix(ingest/bigquery): Deduplicate LogEntries based on insertId, timestamp, logName by @asikowitz in https://github.com/datahub-project/datahub/pull/8132
• feat(ingest/glue): report glue job lineage failures, update doc by @mayurinehate in https://github.com/datahub-project/datahub/pull/8126
• feat(lineage source): add fine grained lineage support by @anshbansal in https://github.com/datahub-project/datahub/pull/7904
• docs(glue): fix broken link by @mayurinehate in https://github.com/datahub-project/datahub/pull/8135
• feat(custom ownership): Adds Custom ownership types as a top level entity by @pedro93 in https://github.com/datahub-project/datahub/pull/8045
• Update updating-datahub.md for v0.10.3 release by @iprentic in https://github.com/datahub-project/datahub/pull/8139
• feat: add dbt-athena adapter support for column types mapping by @svdimchenko in https://github.com/datahub-project/datahub/pull/8116
• docs(csv-enricher): add example csv file & recipe by @gabe-lyons in https://github.com/datahub-project/datahub/pull/8141
• chore(ci): update base requirements file by @anshbansal in https://github.com/datahub-project/datahub/pull/8144
• fix(ingest/s3): Path spec aware folder traversal by @treff7es in https://github.com/datahub-project/datahub/pull/8095
• fix(ui) Fix selecting columns in Lineage tab for CLL by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/8129
• feat(search): adding support for _entityType filter in the application layer + frontend by @gabe-lyons in https://github.com/datahub-project/datahub/pull/8102
• docs(ingest/nifi): fix broken links by @mayurinehate in https://github.com/datahub-project/datahub/pull/8143
• fix(scroll): fix scroll cache key for hazelcast by @RyanHolstien in https://github.com/datahub-project/datahub/pull/8149
• chore(json): fix json vulnerability by @RyanHolstien in https://github.com/datahub-project/datahub/pull/8150
• fix(ingest/json-schema): handle property inheritance in unions by @hsheth2 in https://github.com/datahub-project/datahub/pull/8121
• chore(log): fix log as error instead of info by @anshbansal in https://github.com/datahub-project/datahub/pull/8146
• fix(lineagecounts) Include entities that are filtered out due to sibling logic in the filtered count of lineage counts by @iprentic in https://github.com/datahub-project/datahub/pull/8152
• fix(stats): display consistent query count on stats tab by @joshuaeilers in https://github.com/datahub-project/datahub/pull/8151
• fix(ingest): remove original_table_name logic in sql source by @hsheth2 in https://github.com/datahub-project/datahub/pull/8130
• feat(ingest): add more fail-safes to stateful ingestion by @hsheth2 in https://github.com/datahub-project/datahub/pull/8111
• feat(ingest/snowflake): support for more operation types by @mayurinehate in https://github.com/datahub-project/datahub/pull/8158
• fix(ui) Show Entities first on Domain pages again by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/8159
• fix(ingest/nifi): allow nifi site url with context path by @mayurinehate in https://github.com/datahub-project/datahub/pull/8156
• feat(ingest): Create Browse Paths V2 under flag by @asikowitz in https://github.com/datahub-project/datahub/pull/8120
• fix(ingestion/looker): set project-name for imported_projects views by @mohdsiddique in https://github.com/datahub-project/datahub/pull/8086
• fix(docs): Fix ownership type typos by @pedro93 in https://github.com/datahub-project/datahub/pull/8155
• docs(townhall) feb and march town hall agenda and recording by @maggiehays in https://github.com/datahub-project/datahub/pull/7676
• feat(ingest/unity): Add qualified name to dataset properties by @asikowitz in https://github.com/datahub-project/datahub/pull/8164
• feat(ingest/bigquery_v2): enable platform instance using project id by @Khurzak in https://github.com/datahub-project/datahub/pull/8142
• feat(ingest/snowflake): Deprecate legacy lineage and optimize query history joins by @asikowitz in https://github.com/datahub-project/datahub/pull/8176
• fix(ingest/kafka): Fixing error printing in Kafka properties get call by @treff7es in https://github.com/datahub-project/datahub/pull/8145
• fix(ingest/snowflake): set use_quoted_name to profile lowercase tables by @mayurinehate in https://github.com/datahub-project/datahub/pull/8168
• feat(classification): support for regex based custom infotypes by @mayurinehate in https://github.com/datahub-project/datahub/pull/8177
• fix(restli): update base client retry logic by @david-leifker in https://github.com/datahub-project/datahub/pull/8172
• fix(ingest): Fix modeldocgen; bump feast to relax pyarrow constraint by @asikowitz in https://github.com/datahub-project/datahub/pull/8178
• refactor(ci): move from sleep to kafka lag based testing by @shirshanka in https://github.com/datahub-project/datahub/pull/8094
• docs(lineage): document timestamp filtering in lineage feature by @iprentic in https://github.com/datahub-project/datahub/pull/8174
• build(ingest/feast): Pin feast to minor version by @asikowitz in https://github.com/datahub-project/datahub/pull/8180
• feat(ingest/snowflake): Okta OAuth support; update docs by @asikowitz in https://github.com/datahub-project/datahub/pull/8157
• feat(ingest/presto-on-hive): add support for extra properties and merge property capabilities by @treff7es in https://github.com/datahub-project/datahub/pull/8147
• docs(managed datahub): release notes for v0.2.8 by @anshbansal in https://github.com/datahub-project/datahub/pull/8185
• fix(nocode): fix DeleteLegacyGraphRelationshipsStep for Elasticsearch by @david-leifker in https://github.com/datahub-project/datahub/pull/8181
• feat(docker):Add the jattach tool to the docker container(#7538) by @yangjiandan in https://github.com/datahub-project/datahub/pull/8040
• refactor: Return original exception as caused by by @Jorricks in https://github.com/datahub-project/datahub/pull/7722
• docs(ingest) Add MetadataChangeProposalWrapper import to example code by @iprentic in https://github.com/datahub-project/datahub/pull/8175
• fix(ingest/kafka): Better error handling around topic and topic description extraction by @asikowitz in https://github.com/datahub-project/datahub/pull/8183
• fix(vulnerabilities)/vulnerabilities_fixes_datahub (#8075) by @david-leifker in https://github.com/datahub-project/datahub/pull/8189
• fix: add dedicated guide on changing default credentials by @yoonhyejin in https://github.com/datahub-project/datahub/pull/8153
• feat(classification): configurable minimum values threshold by @mayurinehate in https://github.com/datahub-project/datahub/pull/8186
• fix(ingestion/looker): ingest looks not part of dashboard by @mohdsiddique in https://github.com/datahub-project/datahub/pull/8140
• fix(ingest/profiling): only apply monkeypatches once when profiling by @hsheth2 in https://github.com/datahub-project/datahub/pull/8160
• docs(tableau): site config is required for tableau cloud / tableau online by @mohdsiddique in https://github.com/datahub-project/datahub/pull/8041
• fix(ingest/bigquery): Swap log order to avoid confusion by @asikowitz in https://github.com/datahub-project/datahub/pull/8197
• fix(ingest/redshift): Adding env parameter where it was missing for urn generation by @treff7es in https://github.com/datahub-project/datahub/pull/8199
• revert(ingest/bigquery): Do not emit DataPlatformInstance; remove references to platform_instance by @asikowitz in https://github.com/datahub-project/datahub/pull/8196
• docs(managed datahub): add docs link to v0.2.8 by @anshbansal in https://github.com/datahub-project/datahub/pull/8202
• Add combined health check endpoint which can check multiple components by @iprentic in https://github.com/datahub-project/datahub/pull/8191
• chore(cp-schema-registry): bump minor version by @david-leifker in https://github.com/datahub-project/datahub/pull/8192
• feat(ingest): Produce browse paths v2 on demand and with platform instance by @asikowitz in https://github.com/datahub-project/datahub/pull/8173

New Contributors

• @svdimchenko made their first contribution in https://github.com/datahub-project/datahub/pull/8116
• @Khurzak made their first contribution in https://github.com/datahub-project/datahub/pull/8142
• @Jorricks made their first contribution in https://github.com/datahub-project/datahub/pull/7722

Full Changelog: https://github.com/datahub-project/datahub/compare/v0.10.3...v0.10.4

v0.10.3

Released on 2023-05-25 by @iprentic.

Release Highlights

User Experience

• Define Data Products via YAML and manage associated entities within a Domain
• Search experience: quickly apply a filter at time of search
• Form-based PowerBI ingestion

Developer Experience

• Progress toward Removing Confluent Schema Registry requirement -- Helm & Quickstart simplifications to follow
  • NOTE: this will only work for new deployments of DataHub; If you have already deployed DataHub with Confluent Schema Registry, you will not be able to disable it
• Delete CLI - correctly handles deleting timeseries aspects
• Ongoing improvements to Quickstart stability
• Support entity types filter in get_urns_by_filter
• Search customization
  • regex based query matching
  • full control over scoring functions (useable on any document field, i.e. tags, deprecated flags, etc)
  • enable/disable fuzzy, prefix, exact match queries

Ingestion

• BigQuery - Improve ingestion disk usage & speed; extract dataset usage from Views
• Unity Catalog - Capture create/last modified timestamps; extract usage; data profiling support
• PowerBI - Update workspace concept mapping; support modified_since, extract_dataset_schema, and more
• Superset – support stateful ingestion
• Business Glossary – Simplify ingestion source
• Kafka – Add description in dataset properties
• S3 – Support stateful ingestion & last_updated
• CSV Enricher – Support updating more types
• PII Classification - Configurable sample size
• Nifi - Support Kerberos authentication

What's Changed

• fix(ingest/bigquery): Add to lineage, not overwrite, when using sql parser by @asikowitz in https://github.com/datahub-project/datahub/pull/7814
• fix(ingest/bigquery): Enable lineage and usage ingestion without tables by @asikowitz in https://github.com/datahub-project/datahub/pull/7820
• fix(ingest/bigquery): Do not query columns when not ingesting tables or views by @asikowitz in https://github.com/datahub-project/datahub/pull/7823
• fix(ingest/bigquery): update usage query, remove erroneous init by @mayurinehate in https://github.com/datahub-project/datahub/pull/7811
• fix(ingest/bigquery): Handle null values from usage aggregation by @asikowitz in https://github.com/datahub-project/datahub/pull/7827
• perf(ingest/bigquery): Improve bigquery usage disk usage and speed by @asikowitz in https://github.com/datahub-project/datahub/pull/7825
• fix(cli): use correct ingestion image in script by @hsheth2 in https://github.com/datahub-project/datahub/pull/7826
• fix(release): prevent republish of images on release edits by @RyanHolstien in https://github.com/datahub-project/datahub/pull/7828
• feat(): finish populating the entity registry by @hsheth2 in https://github.com/datahub-project/datahub/pull/7818
• fix(ui) Fix 404 page routing bug by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/7824
• feat(ui): Support PowerBI Ingestion via UI form by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/7817
• fix(ingest/snowflake): fix column name in snowflake optimised lineage by @mayurinehate in https://github.com/datahub-project/datahub/pull/7834
• feat(ingest/unity): capture create/lastModified timestamps by @hsheth2 in https://github.com/datahub-project/datahub/pull/7819
• fix(test): fix spark lineage test by @david-leifker in https://github.com/datahub-project/datahub/pull/7829
• docs(): add markprompt help chat by @jeffmerrick in https://github.com/datahub-project/datahub/pull/7837
• Update DataJobInputOutput.pdl to express that CLL fields are not shown in the UI right now by @gabe-lyons in https://github.com/datahub-project/datahub/pull/7830
• feat(cli): improve quickstart stability by @hsheth2 in https://github.com/datahub-project/datahub/pull/7839
• chore(ci): regular upgrade base requirements.txt by @anshbansal in https://github.com/datahub-project/datahub/pull/7821
• feat(timeseries): Support sorting timeseries aspects by non-timestampMillis field + fix operations resolver by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/7840
• doc(ingestion/tableau): Fix rendering ingestion quickstart guide by @mohdsiddique in https://github.com/datahub-project/datahub/pull/7808
• fix(ingest): pin sqlparse version by @hsheth2 in https://github.com/datahub-project/datahub/pull/7847
• feat(urn): Add a validator when creating an URN that it is no longer than the li… by @iprentic in https://github.com/datahub-project/datahub/pull/7836
• chore(ingest): bug fix in sqlparse pin by @hsheth2 in https://github.com/datahub-project/datahub/pull/7848
• feat: enriching guide on creating dataset by @yoonhyejin in https://github.com/datahub-project/datahub/pull/7777
• feat(docs): consolidate api guides by @yoonhyejin in https://github.com/datahub-project/datahub/pull/7857
• fix(ingest/salesforce): use report timestamp for operations by @hsheth2 in https://github.com/datahub-project/datahub/pull/7838
• chore(ci): fix CI failing due to lint by @anshbansal in https://github.com/datahub-project/datahub/pull/7863
• fix(mcl): fix improper pass by reference by @RyanHolstien in https://github.com/datahub-project/datahub/pull/7860
• feat(urn) Add validator to reject URNs which contain the character we plan to u… by @iprentic in https://github.com/datahub-project/datahub/pull/7859
• feat(elasticsearch): Add servlet which provides an endpoint for a healthcheck on the ES cl… by @iprentic in https://github.com/datahub-project/datahub/pull/7799
• fix(ui) Add UI fixes and design tweaks to AutoComplete by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/7845
• fix(ui) Get all entity assertions in chrome extension by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/7849
• refactor(platform): Refactoring ES Utils, adding EXISTS condition support to Filter Criterion by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/7832
• chore(ui): change background color to transparent for avatar with photoUrl by @hieunt-itfoss in https://github.com/datahub-project/datahub/pull/7527
• refactor(ingest): Add helper DataHubGraph methods by @asikowitz in https://github.com/datahub-project/datahub/pull/7851
• fix(ui) Disable cache on Domain and Glossary Related Entities pages by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/7867
• fix(cache): Fix cache key serialization in search service by @pedro93 in https://github.com/datahub-project/datahub/pull/7858
• docs(ingest): update dbt and aws docs by @hsheth2 in https://github.com/datahub-project/datahub/pull/7870
• docs(ingest): fix CorpGroup example by @hsheth2 in https://github.com/datahub-project/datahub/pull/7816
• docs(ingest/powerbi): update workspace concept mapping by @eeepmb in https://github.com/datahub-project/datahub/pull/7835
• feat(ingest/powerbi): support modified_since, extract_dataset_schema and many more by @aezomz in https://github.com/datahub-project/datahub/pull/7519
• Remove usages of commons-text library lower than 1.10.0 by @iprentic in https://github.com/datahub-project/datahub/pull/7850
• feat(glue): allow resource links to be ignored by @YusufMahtab in https://github.com/datahub-project/datahub/pull/7639
• feat(ingestion): lookml refinement support by @mohdsiddique in https://github.com/datahub-project/datahub/pull/7781
• feat(ingest/unity): Ingest ownership for containers; lookup service principal display names by @asikowitz in https://github.com/datahub-project/datahub/pull/7869
• Logging and test models fixes by @david-leifker in https://github.com/datahub-project/datahub/pull/7884
• feat(model) Add ContainerPath aspect model by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/7774
• bug(7882): run kafka-configs.sh on DataHubUpgradeHistory_v1 to make sure the retention.ms is set to infinite by @jinlintt in https://github.com/datahub-project/datahub/pull/7883
• fix: refactor toc by @yoonhyejin in https://github.com/datahub-project/datahub/pull/7862
• feat(cli): Modifies ingest-sample-data command to use DataHub url & token based on config by @pedro93 in https://github.com/datahub-project/datahub/pull/7896
• feat(ingest/snowflake): optionally emit all upstreams irrespective of recipe pattern by @mayurinehate in https://github.com/datahub-project/datahub/pull/7842
• fix(ingestion/tableau): backward compatibility with version 2021.1 an… by @mayurinehate in https://github.com/datahub-project/datahub/pull/7864
• fix(ingest/dbt): ensure dbt shows view properties by @hsheth2 in https://github.com/datahub-project/datahub/pull/7872
• docs(airflow): add debug guide on url generation by @hsheth2 in https://github.com/datahub-project/datahub/pull/7885
• feat(sdk): support entity types filter in get_urns_by_filter by @hsheth2 in https://github.com/datahub-project/datahub/pull/7902
• fix(ingest/snowflake): fix optimised lineage query, filter temporary … by @mayurinehate in https://github.com/datahub-project/datahub/pull/7894
• fix(ingest/bigquery): fix handling of time decorator offset queries by @mayurinehate in https://github.com/datahub-project/datahub/pull/7843
• fix(ingest): fix minor bug + protective dep requirements by @hsheth2 in https://github.com/datahub-project/datahub/pull/7861
• fix(cli): remove duplicate labels from quickstart files by @hsheth2 in https://github.com/datahub-project/datahub/pull/7886
• Revert "feat(cli): Modifies ingest-sample-data command to use DataHub… by @pedro93 in https://github.com/datahub-project/datahub/pull/7899
• feat(sdk): add DataHubGraph.get_entity_semityped method by @hsheth2 in https://github.com/datahub-project/datahub/pull/7905
• test(ingest/biz-glossary): add test for enable_auto_id by @hsheth2 in https://github.com/datahub-project/datahub/pull/7911
• feat(ingest): add GCS ingestion source by @mayurinehate in https://github.com/datahub-project/datahub/pull/7903
• [bugfix] Fix remote file ingestion for Windows by @xiphl in https://github.com/datahub-project/datahub/pull/7888
• refactor(ingest): report soft deleted stale entities with LossyList by @asikowitz in https://github.com/datahub-project/datahub/pull/7907
• fix(platforms): fix json parse exception for data platforms by @RyanHolstien in https://github.com/datahub-project/datahub/pull/7918
• docs(release): managed DataHub 0.2.6 by @anshbansal in https://github.com/datahub-project/datahub/pull/7922
• fix(deploy): add missing plugin files for mysql-client library in mysql-setup by @AndrewZures in https://github.com/datahub-project/datahub/pull/7909
• docs(deploy): document some of the environment variables by @david-leifker in https://github.com/datahub-project/datahub/pull/7906
• fix(system-update): fix no wait flag by @david-leifker in https://github.com/datahub-project/datahub/pull/7927
• fix(consumer): fix datahub usage event topic consumer by @david-leifker in https://github.com/datahub-project/datahub/pull/7866
• logging(auth): adding optional logging to authentication exceptions by @david-leifker in https://github.com/datahub-project/datahub/pull/7929
• feat(search): enable search initial customization by @david-leifker in https://github.com/datahub-project/datahub/pull/7901
• feat(schema-registry): replace confluent schema registry by @david-leifker in https://github.com/datahub-project/datahub/pull/7930
• feat(ingest/unity): Add usage extraction; add TableReference by @asikowitz in https://github.com/datahub-project/datahub/pull/7910
• fix(ingest/unity-catalog): Add usage_common dependency to unity catalog plugin by @asikowitz in https://github.com/datahub-project/datahub/pull/7935
• feat(search): add filter for specific entities by @iprentic in https://github.com/datahub-project/datahub/pull/7919
• fix(ingest/unity): Add sqllineage dependency by @asikowitz in https://github.com/datahub-project/datahub/pull/7938
• fix(ingest/hive): fix containers generation for hive by @mayurinehate in https://github.com/datahub-project/datahub/pull/7926
• docs(ingest): add note about path_specs configuration in data lake sources by @mayurinehate in https://github.com/datahub-project/datahub/pull/7941
• feat: add missing python sdk guides based on DatahubGraph by @yoonhyejin in https://github.com/datahub-project/datahub/pull/7875
• fix(ingest/unity): use fully qualified catalog/schema patterns by @hsheth2 in https://github.com/datahub-project/datahub/pull/7900
• feat(airflow): respect port parameter if provided by @hsheth2 in https://github.com/datahub-project/datahub/pull/7945
• fix(ingest): improve error message when graph connection fails by @hsheth2 in https://github.com/datahub-project/datahub/pull/7946
• fix(docs): Adding relationship types section to Business Glossary docs by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/7949
• docs(ingest): update max_threads default value by @felipeac in https://github.com/datahub-project/datahub/pull/7947
• fix(ui) Fix Tag Details button to use url encoding by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/7948
• docs: amend italic formatting by @HansBambel in https://github.com/datahub-project/datahub/pull/7893
• fix(ldap): properly handle escaped characters in LDAP DNs by @Reilman79 in https://github.com/datahub-project/datahub/pull/7928
• docs(ingest/postgres): add example with ssl configuration by @hsheth2 in https://github.com/datahub-project/datahub/pull/7916
• refactor(ingest/biz-glossary): simplify business glossary source by @hsheth2 in https://github.com/datahub-project/datahub/pull/7912
• fix: Fix broken links on PowerBI by @yoonhyejin in https://github.com/datahub-project/datahub/pull/7959
• feat(model) Update aspect containerPath -> browsePathsV2 by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/7942
• fix(ui) Fix displaying column level lineage for sibling nodes by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/7955
• fix(ingest/bigquery): Filter projects for lineage and usage by @asikowitz in https://github.com/datahub-project/datahub/pull/7954
• feat(tracking) Add tracking events to our chrome extension page by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/7967
• fix(search): Handle .keyword properly in the entity type query to ind… by @iprentic in https://github.com/datahub-project/datahub/pull/7957
• feat(es) Store and map containerPath to elastic search properly by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/7898
• fix: build vercel python from source by @hsheth2 in https://github.com/datahub-project/datahub/pull/7972
• feat(models): Make assets searchable by their external URLs by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/7953
• fix(ingest/salesforce): support JSON web token auth by @matthew-piatkus-cko in https://github.com/datahub-project/datahub/pull/7963
• fix(SearchBar): Restore explore all link by @joshuaeilers in https://github.com/datahub-project/datahub/pull/7973
• fix(ingest/tableau): Add a try catch to LineageRunner parser by @maaaikoool in https://github.com/datahub-project/datahub/pull/7965
• fix(ingest/salesforce): fix lint by @hsheth2 in https://github.com/datahub-project/datahub/pull/7980
• fix(ingest): use certs correctly in rest emitter by @hsheth2 in https://github.com/datahub-project/datahub/pull/7978
• fix(ingestion/redshift) - Fixing schema query by @treff7es in https://github.com/datahub-project/datahub/pull/7975
• chore(log): change sout to log by @anshbansal in https://github.com/datahub-project/datahub/pull/7931
• fix(ingest/redshift): Enabling autocommit for Redshift connection by @treff7es in https://github.com/datahub-project/datahub/pull/7983
• fix(ingest): use with for opened connections by @mayurinehate in https://github.com/datahub-project/datahub/pull/7908
• fix(ingest/unity): improve error message if no scheme in workspace_url by @mayurinehate in https://github.com/datahub-project/datahub/pull/7951
• fix(download as csv): Support download to csv for impact analysis tab by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/7956
• docs(development): update per feedback from community by @david-leifker in https://github.com/datahub-project/datahub/pull/7958
• fix(ingest/bigquery): remove incorrectly used table_pattern filter by @mayurinehate in https://github.com/datahub-project/datahub/pull/7810
• feat(snowflake): add config option to specify deny patterns for upstreams by @mayurinehate in https://github.com/datahub-project/datahub/pull/7962
• fix(docker-compose): make startup more robust with deterministic services' dependencies by @gcernier-semarchy in https://github.com/datahub-project/datahub/pull/7880
• fix(cache): update search cache when skipped, but enabled by @RyanHolstien in https://github.com/datahub-project/datahub/pull/7936
• feat(telemetry): add server version by @RyanHolstien in https://github.com/datahub-project/datahub/pull/7979
• docs: add tips on language switchable tap on docs by @yoonhyejin in https://github.com/datahub-project/datahub/pull/7984
• fix(privileges) Use glossary term manage children privileges for edit docs and links by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/7985
• fix(ingest/postgres): Allow specification of initial engine database; set default database to postgres by @asikowitz in https://github.com/datahub-project/datahub/pull/7915
• refactor(ingest/unity): Use databricks-sdk over databricks-cli for usage query by @asikowitz in https://github.com/datahub-project/datahub/pull/7981
• chore: cleanup some devtool console warnings by @joshuaeilers in https://github.com/datahub-project/datahub/pull/7988
• feat(search): support only searching by quick filter by @joshuaeilers in https://github.com/datahub-project/datahub/pull/7997
• feat(docs): Add cli documentation on how to add custom platforms by @pedro93 in https://github.com/datahub-project/datahub/pull/7993
• fix(search): fix custom search config parsing by @david-leifker in https://github.com/datahub-project/datahub/pull/8010
• fix(auth): guards against creating a user for the system actor by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/7996
• chore(security): update org json json dependency - cve-2022-45688 by @RyanHolstien in https://github.com/datahub-project/datahub/pull/7991
• feat(metrics): add metrics for upgrade steps by @RyanHolstien in https://github.com/datahub-project/datahub/pull/7992
• feat(models): Adding searchable for chart and dashboard url by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/8002
• feat(ingest/s3): Inferring schema from the alphabetically last folder by @treff7es in https://github.com/datahub-project/datahub/pull/8005
• feat(ingest/classification): add classification report by @mayurinehate in https://github.com/datahub-project/datahub/pull/7925
• docs(managed datahub): release notes for v0.2.7 by @anshbansal in https://github.com/datahub-project/datahub/pull/8020
• fix(ui ingest): Fix mapping for token_name, token_value form fields for Tableau by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/8018
• fix(ui): add loading indicator for download as CSV action by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/8003
• fix(ingest/snowflake): fix lineage query aggregation for optimised li… by @mayurinehate in https://github.com/datahub-project/datahub/pull/8011
• feat(ingest/unity): Add profiling support by @asikowitz in https://github.com/datahub-project/datahub/pull/7976
• feat(docs): Add example documentation for scrollAcrossEntities by @pedro93 in https://github.com/datahub-project/datahub/pull/8014
• fix(ingest/unity): Update databricks-cli pin by @asikowitz in https://github.com/datahub-project/datahub/pull/8024
• fix(ingest/s3) Adding missing more-itertools dependency by @treff7es in https://github.com/datahub-project/datahub/pull/8023
• feat(cli): move registry delete to separate subcommand by @hsheth2 in https://github.com/datahub-project/datahub/pull/7968
• fix(sdk): throw errors on empty gms server urls by @hsheth2 in https://github.com/datahub-project/datahub/pull/8017
• feat(ingest/superset): add stateful ingestion by @cccs-Dustin in https://github.com/datahub-project/datahub/pull/8013
• Gitignor'ing generated binary files in OSS by @meyerkev in https://github.com/datahub-project/datahub/pull/8031
• fix(PFP-260): Upgrading sqlite to fix SQLITE-449762 by @meyerkev in https://github.com/datahub-project/datahub/pull/8032
• feat(ingest): support importing local modules by @hsheth2 in https://github.com/datahub-project/datahub/pull/8026
• fix(timeline-events): fix NPE in timeline events by @david-leifker in https://github.com/datahub-project/datahub/pull/8038
• fix(posts): fix formatting for posts where the title can get cut off by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/8001
• fix(ingestion/metabase): metabase connector bigquery lineage fix by @shubhamjagtap639 in https://github.com/datahub-project/datahub/pull/8042
• fix(es) Fix browseV2 index mappings by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/8034
• fix(search): enter key with no query should search all by @joshuaeilers in https://github.com/datahub-project/datahub/pull/8036
• feat(ingest): Allow csv-enricher to update more types by @xiphl in https://github.com/datahub-project/datahub/pull/7932
• fix(search): only show explore all btn on search and home by @joshuaeilers in https://github.com/datahub-project/datahub/pull/8047
• fix(ingest/dbt): fix dbt subtypes for sources by @hsheth2 in https://github.com/datahub-project/datahub/pull/8048
• fix(ingest/bigquery): update usage audit log query to include create/… by @mayurinehate in https://github.com/datahub-project/datahub/pull/7995
• feat(docs): add guide on integration ML system via SDKs by @yoonhyejin in https://github.com/datahub-project/datahub/pull/8029
• refactor(ingest): Make get_workunits() return MetadataWorkUnits by @asikowitz in https://github.com/datahub-project/datahub/pull/8051
• refractor(classification): simplify classification handler by @mayurinehate in https://github.com/datahub-project/datahub/pull/8056
• feat: Add support for Data Products by @shirshanka in https://github.com/datahub-project/datahub/pull/8039
• fix(build): fix lint issue by @shirshanka in https://github.com/datahub-project/datahub/pull/8066
• feat(system-update): remove datahub-update requirement on schema reg by @david-leifker in https://github.com/datahub-project/datahub/pull/7999
• fix(gitignore): update gitignore for generated files by @minjin0121 in https://github.com/datahub-project/datahub/pull/7940
• feat(ingestion/kafka): add description in dataset properties by @shubhamjagtap639 in https://github.com/datahub-project/datahub/pull/7974
• fix(ingestion/tableau): ingest parent project name in container properties by @mohdsiddique in https://github.com/datahub-project/datahub/pull/8030
• refactor(ingest): Move source_helpers.py from datahub/utilities -> datahub/api by @asikowitz in https://github.com/datahub-project/datahub/pull/8052
• fix(ingest/snowflake): lowercase user urn when using email by @matwalk in https://github.com/datahub-project/datahub/pull/7767
• fix(ingest/tableau): don't use unsupported sql condition field by @mayurinehate in https://github.com/datahub-project/datahub/pull/8065
• fix(ingest/looker): don't prematurely show connectivity success by @hsheth2 in https://github.com/datahub-project/datahub/pull/8070
• feat(web): update AWS logos by @rinzool in https://github.com/datahub-project/datahub/pull/8057
• fix(metadata-io): remove assert in favor of exceptions by @david-leifker in https://github.com/datahub-project/datahub/pull/8035
• feat: add docs on column-level linage by @yoonhyejin in https://github.com/datahub-project/datahub/pull/8062
• ci: prevent qodana from using all of our cache by @hsheth2 in https://github.com/datahub-project/datahub/pull/8054
• ci(ingest/clickhouse): don't use kernel ephemeral ports by @hsheth2 in https://github.com/datahub-project/datahub/pull/8060
• test(sdk): better error messages in registry codegen test by @hsheth2 in https://github.com/datahub-project/datahub/pull/8081
• doc(managed datahub): update release notes for 0.2.7 by @anshbansal in https://github.com/datahub-project/datahub/pull/8088
• feat(ingest/s3) - Stateful ingestion and last-updated support by @treff7es in https://github.com/datahub-project/datahub/pull/8022
• docs(ingest/snowflake): fix authentication type docs by @hsheth2 in https://github.com/datahub-project/datahub/pull/8059
• fix(ingest/s3_data_lake)_ingestor_skips_directories_with_similar_prefix by @alplatonov in https://github.com/datahub-project/datahub/pull/8078
• fix(ui) Fix entity name styling to show deprecation and others properly by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/8084
• test(sdk): move cli tests into the unit dir by @hsheth2 in https://github.com/datahub-project/datahub/pull/8028
• feat(sdk): better auth error messages in the rest emitter by @hsheth2 in https://github.com/datahub-project/datahub/pull/8025
• feat(caching): skip cache on ownership tabs by @gabe-lyons in https://github.com/datahub-project/datahub/pull/8082
• feat(embed): embed lookup route by @joshuaeilers in https://github.com/datahub-project/datahub/pull/8033
• fix(ingest/delta-lake): Walk through directory structure with full path; reduce resource creation by @asikowitz in https://github.com/datahub-project/datahub/pull/8072
• feat(search): Add AggregateAcrossEntities endpoint by @iprentic in https://github.com/datahub-project/datahub/pull/8000
• chore(vulnerability): add exclusions for json to prevent leaking dependency by @RyanHolstien in https://github.com/datahub-project/datahub/pull/8090
• fix(ingestion/powerbi): skip erroneous pages of a report by @shubhamjagtap639 in https://github.com/datahub-project/datahub/pull/8021
• feat(docs): Update markprompt by @jeffmerrick in https://github.com/datahub-project/datahub/pull/8079
• feat(images): Add build processes for arm64v8 image variants by @pedro93 in https://github.com/datahub-project/datahub/pull/7990
• feat(ingest): add env to container properties by @hsheth2 in https://github.com/datahub-project/datahub/pull/8027
• fix(checkstyle): Fix checkstyle violations to turn master green by @iprentic in https://github.com/datahub-project/datahub/pull/8099
• doc(auth): fixes doc in DataHubSystemAuthenticator.java by @sgomezvillamor in https://github.com/datahub-project/datahub/pull/8071
• refactor(ingest): Auto report workunits by @asikowitz in https://github.com/datahub-project/datahub/pull/8061
• feat(cli): support datahub ingest mcps by @hsheth2 in https://github.com/datahub-project/datahub/pull/7871
• feat: datahub-upgrade.sh to support old versions by @ollisala in https://github.com/datahub-project/datahub/pull/7891
• feat(ingest/s3): type aware directory sorting by @treff7es in https://github.com/datahub-project/datahub/pull/8089
• fix(ci): add missing updates to restli-spec by @anshbansal in https://github.com/datahub-project/datahub/pull/8106
• fix(ingest/build): setting typing extension <4.6.0 because it breaks tests by @treff7es in https://github.com/datahub-project/datahub/pull/8108
• fix(upgrade): removes sleep from bootstrap process by @RyanHolstien in https://github.com/datahub-project/datahub/pull/8016
• fix(jackson): increase max serialized string length default by @RyanHolstien in https://github.com/datahub-project/datahub/pull/8053
• fix(ui): SchemaDescriptionField 'read-more' doesn't affect table height by @jfrancos-mai in https://github.com/datahub-project/datahub/pull/7970
• fix(ingest): emitter bug fixes by @hsheth2 in https://github.com/datahub-project/datahub/pull/8093
• fix(sample data): Update timestamps in bootstrap_mce.json to more recent by @iprentic in https://github.com/datahub-project/datahub/pull/8103
• feat(ui) Add readOnly flag that disables profile URL editing by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/8067
• feat(cli): delete cli v2 by @hsheth2 in https://github.com/datahub-project/datahub/pull/8068
• refactor(ingest): simplify stateful ingestion provider interface by @hsheth2 in https://github.com/datahub-project/datahub/pull/8104
• Update updating-datahub.md with breaking changes by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/7964
• feat(ui) Show documentation on Domain pages first by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/8110
• docs(readme): adds PITS Global Data Recovery Services to the adopters list by @pheianox in https://github.com/datahub-project/datahub/pull/8080
• fix(ingest/redshift): Making Redshift source more verbose by @treff7es in https://github.com/datahub-project/datahub/pull/8109
• feat(ingest): Browse Path v2 helper by @asikowitz in https://github.com/datahub-project/datahub/pull/8012
• feat(classification): configurable sample size by @mayurinehate in https://github.com/datahub-project/datahub/pull/8096
• fix logic for multiple entities found and clean up messy code by @joshuaeilers in https://github.com/datahub-project/datahub/pull/8113
• fix(search): Update entityType transform logic to work for entities containing by @iprentic in https://github.com/datahub-project/datahub/pull/8112
• feat(ingest/bigquery): usage for views by @mayurinehate in https://github.com/datahub-project/datahub/pull/8046
• fix(ui): Open mailto link in new tab by @jfrancos-mai in https://github.com/datahub-project/datahub/pull/7982
• fix(search): Transform _entityType/index output for scroll across entities as well by @iprentic in https://github.com/datahub-project/datahub/pull/8117
• feat(ingest): Add GenericAspectTransformer by @amanda-her in https://github.com/datahub-project/datahub/pull/7994
• refactor(ingest): Call source_helpers via new WorkUnitProcessors in base Source by @asikowitz in https://github.com/datahub-project/datahub/pull/8101
• feat(ingest/nifi): kerberos authentication by @mayurinehate in https://github.com/datahub-project/datahub/pull/8097
• fix(ingest/redshift):fixing schema filter by @treff7es in https://github.com/datahub-project/datahub/pull/8119
• feat(ingest/unity): Allow ingestion without metastore admin role by @asikowitz in https://github.com/datahub-project/datahub/pull/8091
• feat(ingest/bigquery): Add BigQuery Views lineage extraction from Google Data Catalog API by @viniciusdsmello in https://github.com/datahub-project/datahub/pull/8100
• fix(ingest/redshift): Fixing Redshift subtypes by @treff7es in https://github.com/datahub-project/datahub/pull/8125
• fix(ingest): Fix breaking smoke test on stateful ingestion by @asikowitz in https://github.com/datahub-project/datahub/pull/8128

New Contributors

• @eeepmb made their first contribution in https://github.com/datahub-project/datahub/pull/7835
• @YusufMahtab made their first contribution in https://github.com/datahub-project/datahub/pull/7639
• @AndrewZures made their first contribution in https://github.com/datahub-project/datahub/pull/7909
• @HansBambel made their first contribution in https://github.com/datahub-project/datahub/pull/7893
• @matthew-piatkus-cko made their first contribution in https://github.com/datahub-project/datahub/pull/7963
• @joshuaeilers made their first contribution in https://github.com/datahub-project/datahub/pull/7973
• @gcernier-semarchy made their first contribution in https://github.com/datahub-project/datahub/pull/7880
• @shubhamjagtap639 made their first contribution in https://github.com/datahub-project/datahub/pull/8042
• @minjin0121 made their first contribution in https://github.com/datahub-project/datahub/pull/7940
• @matwalk made their first contribution in https://github.com/datahub-project/datahub/pull/7767
• @rinzool made their first contribution in https://github.com/datahub-project/datahub/pull/8057
• @alplatonov made their first contribution in https://github.com/datahub-project/datahub/pull/8078
• @ollisala made their first contribution in https://github.com/datahub-project/datahub/pull/7891
• @jfrancos-mai made their first contribution in https://github.com/datahub-project/datahub/pull/7970
• @pheianox made their first contribution in https://github.com/datahub-project/datahub/pull/8080

Full Changelog: https://github.com/datahub-project/datahub/compare/v0.10.2...v0.10.3

DataHub v0.10.2

Released on 2023-04-13 by @iprentic.

View the release notes for DataHub v0.10.2 on GitHub.

DataHub v0.10.1

Released on 2023-03-23 by @aditya-radhakrishnan.

View the release notes for DataHub v0.10.1 on GitHub.

DataHub v0.10.0

Released on 2023-02-07 by @david-leifker.

View the release notes for DataHub v0.10.0 on GitHub.

DataHub v0.9.6.1

Released on 2023-01-31 by @david-leifker.

View the release notes for DataHub v0.9.6.1 on GitHub.

DataHub v0.9.6

Released on 2023-01-13 by @maggiehays.

View the release notes for DataHub v0.9.6 on GitHub.

DataHub v0.9.5

Released on 2022-12-23 by @jjoyce0510.

View the release notes for DataHub v0.9.5 on GitHub.

[Known Issues] DataHub v0.9.4

Released on 2022-12-20 by @maggiehays.

View the release notes for [Known Issues] DataHub v0.9.4 on GitHub.

DataHub v0.9.3

Released on 2022-11-30 by @maggiehays.

View the release notes for DataHub v0.9.3 on GitHub.

DataHub v0.9.2

Released on 2022-11-04 by @maggiehays.

View the release notes for DataHub v0.9.2 on GitHub.

DataHub v0.9.1

Released on 2022-10-31 by @maggiehays.

View the release notes for DataHub v0.9.1 on GitHub.

DataHub v0.9.0

Released on 2022-10-11 by @szalai1.

View the release notes for DataHub v0.9.0 on GitHub.

DataHub v0.8.45

Released on 2022-09-23 by @gabe-lyons.

View the release notes for DataHub v0.8.45 on GitHub.

DataHub v0.8.44

Released on 2022-09-01 by @jjoyce0510.

View the release notes for DataHub v0.8.44 on GitHub.

DataHub v0.8.43

Released on 2022-08-09 by @maggiehays.

View the release notes for DataHub v0.8.43 on GitHub.

v0.8.42

Released on 2022-08-03 by @gabe-lyons.

View the release notes for v0.8.42 on GitHub.

v0.8.41

Released on 2022-07-15 by @anshbansal.

View the release notes for v0.8.41 on GitHub.

v0.8.40

Released on 2022-06-30 by @gabe-lyons.

View the release notes for v0.8.40 on GitHub.

v0.8.39

Released on 2022-06-24 by @maggiehays.

View the release notes for v0.8.39 on GitHub.

[!] DataHub v0.8.38

Released on 2022-06-09 by @jjoyce0510.

View the release notes for [!] DataHub v0.8.38 on GitHub.

[!] DataHub v0.8.37

Released on 2022-06-09 by @jjoyce0510.

View the release notes for [!] DataHub v0.8.37 on GitHub.

DataHub V0.8.36

Released on 2022-06-02 by @treff7es.

View the release notes for DataHub V0.8.36 on GitHub.

[!] DataHub v0.8.35

Released on 2022-05-18 by @dexter-mh-lee.

View the release notes for [!] DataHub v0.8.35 on GitHub.

v0.8.34

Released on 2022-05-04 by @maggiehays.

View the release notes for v0.8.34 on GitHub.

DataHub v0.8.33

Released on 2022-04-15 by @dexter-mh-lee.

View the release notes for DataHub v0.8.33 on GitHub.

DataHub v0.8.32

Released on 2022-04-04 by @dexter-mh-lee.

View the release notes for DataHub v0.8.32 on GitHub.

DataHub v0.8.31

Released on 2022-03-17 by @dexter-mh-lee.

View the release notes for DataHub v0.8.31 on GitHub.

Datahub v0.8.30

Released on 2022-03-17 by @rslanka.

View the release notes for Datahub v0.8.30 on GitHub.

DataHub v0.8.29

Released on 2022-03-10 by @shirshanka.

View the release notes for DataHub v0.8.29 on GitHub.