Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
Job Description:
Data Engineer Skills and Technologies Data Engineering:
– Strong understanding of data concepts
– data types, data structures, schemas (both JSON and Spark), schema management etc
– Strong understanding of complex JSON manipulation – Experience working with Data Pipelines using a custom Python/PySpark frameworks
– Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
– Strong understanding of Data Security principles
– data owners, access controls
– row and column level, GDPR etc including experience of handling sensitive datasets
– Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
Requirements
Required Skills:
Languages / Frameworks
– JSON
– YAML
– Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
– SQL
– PySpark
– Delta Lake
– Bash (both CLI usage and scripting)
– Git
– Markdown
– Scala (bonus, not compulsory)
– Azure SQL Server as a HIVE Metastore (bonus) Technologies
– Azure Databricks
– Apache Spark
– Delta Tables
– Data processing with Python
– PowerBI (Integration / Data Ingestion)
– JIRA
...We are looking for a Salesforce CRM Analytics Specialist to support our business by developing and maintaining insightful dashboards, reports, and data models within Salesforce CRM Analytics (formerly Tableau CRM/Einstein Analytics) . You will work closely with business...
...accurately identifies changes in patient conditions and potential violations, enhancing patient care quality. We are now seeking a Virtual Assistant to join our team! From administrative and marketing tasks to inside sales and customer service we hire only the most...
Job Quick Facts: Specialty: Nephrology. Job Type: Locum Tenens. Facility Location: Bloomington, IN. Service Setting: Inpatient. Reason For Coverage: Supplemental. Coverage Period: Aug 25, 2025 - Ongoing. Coverage Type: Call Only. Shifts needed to...
...A leading contractor for FedEx Ground has an immediate opening for a solo Class A Driver willing to team with one of our existing drivers on a dedicated lane. The lane runs from Syracuse to Toledo and back Tuesday through Saturday, and averagesbetween $1750-$1800 per...
**Description**SAIC is looking for an amazingly talented **Systems Engineer** to join our team! In this role you will support the Missile Defense Agency (MDA) Medium Range Targets program office. Your work will cover multiple programs developing the next generation of...