Big Data

We are a innovative fintech looking for Senior Data Engineers to help us design and implement complex data processing systems that support our business needs. You will work closely with cross-functional teams, including data analysts, software developers, and business stakeholders, to build scalable and reliable data pipelines and data models. You will also be responsible for optimizing our data infrastructure and ensuring data quality and accuracy.

Responsibilities:

• Design, develop and maintain scalable, reliable and efficient data processing systems.
• Collaborate with data analysts, software developers and business stakeholders to understand data requirements and design solutions to meet their needs.
• Develop and maintain ETL pipelines to extract data from various sources, transform and load it into our data warehouse.
• Develop and maintain real-time data processing systems using Spark Streaming and Kafka for streaming data sources.
• Implement and maintain data quality and validation checks to ensure data accuracy and consistency.
• Design and maintain data models to support our company’s analytical and reporting needs.
• Troubleshoot and resolve data processing issues, working with cross-functional teams as necessary.
• Monitor and optimize data processing systems to ensure performance, scalability, and reliability.
• Stay up-to-date with the latest data engineering technologies and trends, and recommend new technologies and approaches that can improve our data processing systems.

Requirements:

• Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related field.
• 5+ years of experience as a Data Engineer, with a proven track record of designing and implementing complex data processing systems.
• Proficiency in SQL and experience with one or more programming languages such as Scala, Java or Python.
• Experience with ETL tools such as  Spark, Talend, Informatica etc.
• Experience with BI tools such as Metabase, Tableau, MS etc.
• Strong understanding of data modeling, data quality, and data governance principles.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.
• Preferred Qualifications:
• Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform.
• Understand containerization and orchestration technologies such as Docker and Kubernetes.
• Experience with data streaming technologies such as Apache Kafka and Apache Flink.
• Can read/write in English, good spoken English is a plus

Listed in: Web3 Jobs, Developer Crypto Jobs, Engineering Web3 Jobs, Python Web3 Jobs, Senior Crypto Jobs, Data Web3 Jobs, Full Time Web3 Jobs.