Data Engineer
Financial Industry Regulatory Authority Inc
Contract Rockville, Maryland, United States Posted 8 months ago
About Position
Data Engineer (Contract)
$86.00 / Hourly
Rockville, Maryland, United States
Data Engineer
Contract Rockville, Maryland, United States Posted 8 months ago
Skills
1. At least 7 years of experience programming in Java or Scala 2. Strong experience in big data technologies like AWS EMR and Apache Spark 3. Strong experience with serverless technologies like AWS DynamoDB and AWS Lambda - Chosen database is AWS Aurora 4. Technical experience in all the areas listed below: - Experience working with JSON files as data will be coming in as JSON files - Ability to write complex SQL queries - Strong experience in performance tuning and optimization - Strong unit testing using JUnit or ScalaTest is minimum expectation data testing experience would be great - Git/Maven/GradleDescription
Lead/Senior Big Data Developer - This person will not be leading the team or have any direct reports but will be a senior developer on the team who can provide technical mentorship to other engineers. Preference is to start with candidates local to DC/MD/VA and NYC. This is a 100% remote role and candidates will not be required onsite regularly.
- Prior to an interview with the client, candidates must complete a Glider assessment, which I will send to candidates directly.
Responsibilities
- Scala is main programming language for the team.
- Aurora is database.
- SQL is backend database
- ETL process is Scala/Spark on EMR clusters.
- Code reviews are large aspect of team culture.
- Agile environment with 2-week sprints
- Project Details:
- - Security Lending Project - SEC mandated, multi-year project with a delivery date of Q1 2026
- - High profile project due to SEC mandate - will be on the news
- - First project bringing trade data directly through FINRA - historically data was sent by vendor in batches overnight. This project will include inter-day trade information being sent - could be more transactional steaming data in the future
- Please keep in mind for all FINRA submittals:
- - Full education details must be on resume - if they have a Masters degree, Bachelors must also be included
- - Please send me the candidate's original resume, not a dubbed version
- - Resume must address project details, business challenge, and the candidate's direct accomplishments and contributions to the project - resumes that read like a job description or resumes full of technical jargon do not land well
By applying to a job using PingJob.com you are agreeing to comply with and be subject to the PingJob.com Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.