Job Description

ComResource is searching for a highly skilled Data Engineer with a background in SQL and Databricks that can handle the design and construction of scalable management systems, ensure that all data systems meet company requirements, and also research new uses for data acquisition.

Requirements:

• Design, construct, install, test and maintain data management systems.
• Build high-performance algorithms, predictive models, and prototypes.
• Ensure that all systems meet the business/company requirements as well as industry practices.
• Integrate up-and-coming data management and software engineering technologies into existing data structures.
• Develop set processes for data mining, data modeling, and data production.
• Create custom software components and analytics applications.
• Research new uses for existing data.
• Employ an array of technological languages and tools to connect systems together.
• Recommend different ways to constantly improve data reliability and quality.

Qualifications:

• 5+ years data quality engineering
• Experience with Cloud-based systems, preferably Azure
• Databricks and SQL Server testing
• Experience with ML tools and LLMs
• Test automation frameworks
• Python and SQL for data quality checks
• Data profiling and anomaly detection
• Documentation and quality metrics
• Healthcare data validation experience preferred
• Test automation and quality process development

Plus:

• Azure Databricks
• Azure Cognitive Services integration
• Databricks Foundational model Integration
• Claude API implementation a plus
• Python and NLP frameworks (spaCy, Hugging Face, NLTK)

Job Tags

Similar Jobs