Data Engineer
Simetrik
This job is no longer accepting applications
See open jobs at Simetrik.See open jobs similar to "Data Engineer" FinTech Collective.About the role
As a Data Engineer, you will play a pivotal role in developing and optimizing data pipelines and infrastructures to support our data-driven decision-making processes. Your primary objective will be to build and maintain systems that efficiently collect, manage, and transform raw data into actionable insights, facilitating easy analysis and meeting various business needs.
You will leverage technologies such as Snowflake, Python, and Airflow to design, build, and sustain scalable data systems. Collaboration with data scientists, analysts, and other stakeholders will be essential to ensure the data infrastructure aligns with the company's goals and objectives.
Minimum qualifications
- Bachelor's degree in Computer Science, Engineering, or related fields.
- 1-2 years of industry experience as a Data Engineer or in a similar role.
- Proficient in object-oriented programming languages, particularly Python, and experience with related libraries such as Pandas, Dask, NumPy, and Matplotlib.
- Advanced SQL skills and experience with relational databases and database design.
- Experience working with cloud data warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure).
- Proficiency in using data pipelines and workflow management tools (e.g., Airflow).
- Experience working with version control systems, specifically Git.
- Proven experience in developing and maintaining ETL/ELT pipelines.
- Expertise in pre-processing and cleaning large datasets for training models
Preferred qualifications
- Knowledge of cloud platforms (e.g., AWS) and experience deploying pipelines in production environments.
- Familiarity with data monitoring platforms.
- Experience working with large datasets and distributed computing frameworks (e.g., Hive, Hadoop, Spark, Presto, MapReduce).
- Good understanding of NoSQL databases like Redis, Cassandra, MongoDB, or Neo4j.
- Experience in the payments, banking, or accounting sector is a significant plus.
- Familiarity with continuous integration and deployment (CI/CD) pipelines.
- Knowledge of Docker, Kubernetes, and other containerization technologies.
- Experience working with Streaming pipelines and tools.
Responsibilities
- Ensure data accuracy, integrity, privacy, security, and compliance through rigorous quality control procedures.
- Monitor and analyze the performance of data systems, implementing optimization strategies as needed.
- Develop ETL (extract, transform, load) processes to help extract and manipulate data from multiple sources.
- Acquire, clean, and prepare relevant datasets for analysis and reporting.
- Document processes, results, and methodologies to ensure clarity and facilitate maintenance.
- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and provide integrated solutions.
- Work with version control systems, specifically Git, to manage codebase.
- Ensure effective data monitoring and implement improvements as necessary.
- Stay updated with the latest industry trends and technologies to ensure best practices are applied.
- Develop and maintain data pipelines using technologies such as Snowflake, Python and workflow management tools (e.g., Airflow).
- Utilize advanced SQL skills for complex queries
Benefits:
- Well-funded and proven startup with large ambitions and competitive salaries.
- Entrepreneurial culture where pushing limits, creating and collaborating is everyday business.
- Open communication with management and company leadership
- Small, dynamic teams = massive impact
- 100% Remote Work (You choose where to work from)
- 500USD a year for you to invest in learning.
Simetrik considers qualified applicants for employment without regard to race, gender, age, color, religion, national origin, marital status, disability, sexual orientation, gender identity/expression, protected military/veteran status, or any other legally protected factor.
Join a team of incredibly talented people that build things, are free to create and love collaborating!
I authorize Simetrik to be the data controller and, as such, it may collect, store and use for the purposes of my possible hiring, under the conditions described in this document. I also give my consent to Simetrik to treat my personal data information in accordance with the Personal Data Treatment Policy available at https://simetrik.com/, which was made known to me before collecting my personal data.
This job is no longer accepting applications
See open jobs at Simetrik.See open jobs similar to "Data Engineer" FinTech Collective.