Job Description
Remote Lead Data Engineer needs 7+ years' experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
Remote Lead Data Engineer requires:
Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with:
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
- Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Mandatory Skills Advanced knowledge one of language: Java, Scala, Python, C#? Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
Proficient with Data mining/programming tools (e.g.?SAS, SQL, R, Python) Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
Remote Lead Data Engineer duties:
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services.
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
Employment Type: Full-Time
Salary: $ 110.00 Per Hour
Job Tags
Hourly pay, Full time,
Similar Jobs
All Care Therapies
...Therapies companyhas partnered with Therapy Blocks LLC, to deliver teletherapy in-home speech, for pediatrics with various disorders and... ...Nevada licensure! Are you Interested in Teletherapy? Join our SLP team! We are actively seeking part-time and full-time Speech...
Keller Executive Search
...territories Pipeline Management : Build and manage a robust sales pipeline through disciplined CRM usage and activity-based KPIs... ...Experience : Prior experience with van-upfit, shelving, or flooring suppliers Leadership : Mentoring ability and experience...
Go McPherson
...tasking, taking initiative, travel, and intentionally building and nurturing relationships with people. Education & Experience ~ Bachelors degree or higher in a related field ~1+ years of admissions, sales, or customer service experience preferred ~ Valid driver...
Kintock Group
...contracting agency clearance requirements.~Maintain a valid drivers license in good standing.Academic and work experiences:A bachelors degree in business, Criminal Justice, or a Social Science and one year of relevant work experience in an adult human service...
Tumbleweed Tiny House Company
...Apply here: https://tumbleweed-tiny-house-company.prismhr-hire.com/job/549218/hot-sh...Must have:Your own businessDOT numberCDL (A, B or C)Cargo Insurance1 ton truck or greaterExcellent people skillsOur tiny homes require white glove delivery service and...