Job brief.
Job Role: Quantexa Data Engineer
Exp: 10 – 15 Y
Location: Bangalore
Key Responsibilities.
- Skill set for “Quantexa” project- Experience working with Graph databases- Graph QL language, Scala as operating language. Big data tech such as spark or Pyspark.
- Design, develop, and maintain robust data pipelines using Scala and Apache Spark for big data processing.
- Implement and optimize Quantexa solutions to create powerful data models, including customer and entity resolution, fraud detection, and risk scoring.
- Work with the data science and analytics teams to develop models using Quantexa’s scoring engine and integrate them into the broader data architecture.
- Ensure the efficient processing and integration of large datasets across a variety of sources (structured, semi-structured, and unstructured).
- Develop and maintain data workflows that ensure the scalability, performance, and reliability of data processes.
- Collaborate with business analysts and data scientists to understand the business requirements and provide effective data engineering solutions.
- Manage, monitor, and improve the performance of existing data pipelines.
- Troubleshoot and resolve any issues with data processes, performance, or integration.
- Ensure data quality, integrity, and security in all aspects of data engineering work.
- Participate in code reviews, knowledge sharing, and best practice discussion.
Qualifications.
- Quantexa experience (ideally, with a Quantexa scoring certificate).
- Strong experience with Scala and Apache Spark for big data processing.
- Solid understanding of data engineering best practices and principles.
- Experience with building and optimizing data pipelines and ETL processes.
- Knowledge of SQL and experience working with relational databases