Job Description:
Data Engineer (Data Catalog, Metadata Management)
This position is to develop, manage, integrate and maintain Data Catalog and Metadata system in Cloud.
Any experience on Enterprise Data Catalog tools such as Azure Purview, Collibra, or Alation is desired.
Data deliverables
Data Catalog (Purview, Collibra, Alation, or similar)
Data Integration (Batch & Near Real Time metadata related)
Data Migration
Metadata management experience is desired
Hands on data service/programming languages experience is must
Databricks
PySpark
Web Service Restful API
Azure Data Factory
Azure Data Lake, Synapse, Cosmos DB
SQL
Purview, Collibra, Alation, or similar is desired.