Develop and manage a data warehouse platform for a FinTech firm using Databricks, focusing on performance, scalability, and maintainability.
Roles/Responsibilities
- Design and develop data warehouse solutions using Databricks.
- Write well-structured, production-quality code for data processing and analytics.
- Utilize public cloud platforms for data infrastructure.
- Leverage machine learning frameworks and libraries to optimize processes.
- Manage the end-to-end lifecycle of data pipelines and workflows.
- Collaborate with teams to enhance system reliability and data observability.
Required skills
- 3+ years of python development experience, and ability to write production-level code.
- Proficiency with public cloud services AND the Databricks platform.
- Experience with common machine learning frameworks and libraries.
Preferred skills
- Experience in deploying and training machine learning models with MLOps tools
- Hands-on experience with CI/CD, data modeling, and performance tuning.
- Proficiency with orchestration tools like Airflow or Kubeflow.
About our client
A major FinTech firm with a very high number of monthly active users. Our client is enjoying a very level of public trust and enjoys a very stable business model.
