Sr. Data Engineer
Philadelphia, PA
Fulltime
Job Description
Experience (in Yrs) 10-12 years Technical/Functional
Skills :Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins,
Roles & Responsibilities
- Hands-on architecture/development of ETL pipelines using our internal framework written in Java.
- Hands-on architecture of real time REST APIs or other solutions for streaming data from Graph using Spark
- Interpret data, analyze results using statistical techniques and provide ongoing reports.
- Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality.
- Experienced with Databricks
- Acquire data from primary or secondary data sources and maintain databases/data systems.
- Identify, analyze, and interpret trends or patterns in complex data sets.
- Filter and clean data by reviewing reports and performance indicators to locate and correct problems.
- Work with management to prioritize business and information needs.
- Locate and define new process improvement opportunities Generic Managerial Skills Motivated team player with excellent communication, interpersonal, analytical and problem solving skills.
Job Type: Full-time
Pay: $70.00 - $75.00 per hour
Experience level:
- 10 years
- 11+ years
- 8 years
- 9 years
Schedule:
- Day shift
- Monday to Friday
Work Location: In person