Big Data Engineer Jobs in Chicago, IL

Refine Results
1 - 20 of 282 Jobs

Big Data Engineer

Diamond Pick

Remote

Contract

POSITION SUMMARY: The Big Data Engineer is responsible for designing and developing data pipelines, ensuring efficient data processing, and maintaining data infrastructure. They work with large-scale data sets, implement ETL (Extract, Transform, Load) processes, and collaborate with cross-functional teams to meet business needs. RESPONSIBILITIES: Designing and Building Data Pipelines Develop and maintain data processing pipelines using Python, PySpark, and Big Data technologies (e.g., Dataproc

Big Data Engineer (Azure)

Tiger Analytics

Chicago, Illinois, USA

Full-time

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best global analytics consulting team in

Big Data Engineer

ADDSOURCE

Remote

Third Party

Role: Bigdata Developer Exp Required: 12+Years Location: Remote Mandatory Skills: Spark, Scala EMR and AWS Job Description Bachelor's degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployme

AWS Glue Big data engineer

System Soft Technologies

Remote

Contract

System Soft Technologies is widely recognized for its professionalism, strong corporate morals, customer satisfaction, and effective business practices. We provide a full spectrum of business and IT services and solutions, including custom application development, enterprise solutions, systems integration, mobility solutions, and business information management. System Soft Technologies combines business domain knowledge with industry-specific practices and methodologies to offer unique solution

Bigdata Hadoop Engineer

Softsol Resources Inc

Remote or California City, California, USA

Contract

Please send me your resume to if you are interested and can be able to work on W2. Need local to California Job Title: Hadoop Engineer- CR243 Location: Remote but looking local to California. Duration : Long Term Job Description: MUST Have SKILLS. Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must. Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must. 4-5 experience building data pipelines using Hadoop components Sqoop, Hive, S

Big Data Engineer - (Remote / Only for W2)

Primus Software Corp

Remote

Contract

Job Title: Big Data Platform Development Engineer Duration: 6 - 7+ months Contract Possibility of extension Locations: Remote - Texas *Only W2 Candidates* Discription: You will evolve the data cloud platform and building pipelines that are scalable, robust and resilient, to validate, ingest, normalize/enrich and support business rule processing of data. You will provide leadership in big data and cloud technologies. 5+ years of experience with Big Data pipelines with Spark in Java, Scala, Pyth

Senior Scala Software Engineer

JBC powered by Workgenius

Remote

Contract

Senior Software Engineer (Java / Scala) with Top Mass Media & Entertainment Company Senior Software Engineer (Java / Scala) Location: Remote Rate: up to $88.00/HR W2 Duration: 18 months Summary: The Ad Intelligence team is under Ad Platforms and its mission is to transform advertising and the Ad platform with data and AI across TV and streaming video. We build solutions to measure and optimize every aspect of the advertising life cycle. Our tenant is a strong cross-domain team to deliver E2E sol

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin

Sr Data Engineer

The Connors Group, Inc.

Remote

Full-time

The Senior Engineer is responsible for the design, development, implementation and support of ELT processes for Data Platform. Works as part of a team to develop data pipelines, data transformation logic in ADF, python or Scala and other technologies to move data from a variety of operational platforms into Azure cloud. Conduct performance tuning of ELT processes for large and medium volumes of data, develop and oversee monitoring systems to ensure data loads complete on schedule and data is acc

Principal Java Risk Management Software Engineer

Request Technology, LLC

Chicago, Illinois, USA

Full-time

We are unable to sponsor for this permanent full-time role Position is bonus eligible Prestigious Financial Institution is currently seeking a Principal Java Risk Management Software Engineer. Candidate will develop and maintain risk models for margin, clearing fund and stress testing with the focus on developing and maintaining risk model software in production, and environments and infrastructure used in model implementation and testing. Candidate will collaborate with other developers, quanti

ETL/Bigdata Test Lead

ClifyX

Chicago, Illinois, USA

Third Party, Contract

ClifyX group is an award winning IT Consultancy formed in 1998. Our Mission is to provide our clients with Optimal Technology solutions that are effective and within budgets. We specialize in helping Organizations to review their strategic SOW Projects/Talent needs and implement high value and cost effective solutions to increase profitability and efficiency. Our consulting capabilities include expertise in Cloud, Artificial Intelligence, Data Analytics and compliance aspects of Cyber Security d

ETL Developer

iMinds Technology Systems, Inc.

Elk Grove Village, Illinois, USA

Contract

Job Role: ETL Informatica Job Mode: Onsite Location: Chicago, IL Implementation: Infosys Experience: 10+ years Type : W2 Job Details: Must Have Skills DataStage, Azure, Bigdata, ControlM, Databricks Detailed Job Description Relevant required 8+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment. Good knowledge on Azure and Databricks. . Developing DataStage jobs and loading data into Teradata. Having knowledge on ControlM Partic

Data Engineer II

The Connors Group, Inc.

Remote

Full-time

The Data Engineer II plays a critical role in engineering of data solutions that support the reporting and analytic needs. As a key member of the Data engineering team, will work on diverse data technologies such as Steramsets, dbt, data ops and others to build insightful, scalable, and robust data pipelines that feed our various analytics platforms. ESSENTIAL FUNCTIONS: Design and Model data engineering pipelines that support company reporting and analytic needs. Engineer efficient, adaptable,

Director, AI and Data Science

Request Technology, LLC

Chicago, Illinois, USA

Full-time

Director, AI and Data Science Salary: Open + Bonus Available in any of the following locations: Chicago, IL / Houston, TX / Salt Lake City, UT Hybrid: 3 days onsite, 2 days remote *We are unable to provide sponsorship for this role* Qualifications Bachelor s degree in a relevant field is required, and an advanced degree or relevant certifications are highly preferred.10+ years of relevant experience in AI, data science, or related fields, with a proven track record in professional services indus

Senior Azure Databricks Developer

Ventures Unlimited

Chicago, Illinois, USA

Full-time

Job Title: Senior Azure Databricks Developer Location: Chicago, IL - onsite from day one Type: Full Time Position Job Description: Relevant Experience (in Yrs): 10+ years Experience required: Overall 10+ years of experience as developer in Big data technologies like Databricks/Spark and Hadoop ecosystemsExperience in developing Spark applications using spark-SQL in Databricks for data extraction, transformation and aggregation from multiple file formats for analyzing and transforming the data

Distinguished Engineer, Card Tech Data

Capital One

Chicago, Illinois, USA

Full-time

West Creek 2 (12072), United States of America, Richmond, Virginia Distinguished Engineer, Card Tech Data Distinguished Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe diversity of thought strengthens our ability to influence, collaborate and provide the most innovative solutions across organizational boundaries. Distinguished Engineers will significantly impact our trajectory and devise clear roadmaps to d

Senior Software Engineer - ModBus, DNP3, .NET [REMOTE]

Technology Navigators

Remote

Full-time

No sponsorship. No third-party/C2C candidates. Senior Software Engineer C#, .NET Core, PostGres, Modbus, DNP3 REMOTE, must reside in Texas Salary: 120-135K DOE Benefits: Medical, Dental, and Vision Insurance, Flexible Spending Account, Long and Short term Disability, 401K Match, Unlimited PTO *This is an exclusive, off-market opportunity. Our client searches are confidential.* Apply now to learn more about this unique new position! What you get to do: Operate independently in a distributed team

Associate Principal, Software Engineering: Java

Judge Group, Inc.

Chicago, Illinois, USA

Full-time

Location: Chicago, IL Salary: $145,000.00 USD Annually - $160,000.00 USD Annually Description: Our client in the capital market/financial services space is currently seeking a Java Developer to join their team. This is a full-time position, with a base + bonus compensation structure and a hybrid schedule (3 days in the office, 2 remote). This is an exciting time to join their firm as they are in the middle of a transformation. They are rebuilding a key platform from scratch and migrating to

Core Java Developer

Apex Systems

Chicago, Illinois, USA

Full-time

Job#: 2016026 Job Description: Apex Systems combines with parent company On Assignment to make it the 2nd largest IT staffing agency in the country. Apex has an opportunity for a Core Java Developer for a financial client in Chicago, IL (hybrid). If interested in discussing the position further, please send an MS Word version of your resume to Brittany at Here are the details: Position: Java Developer Location: Chicago Rate: 60-70/hr W2 Duration: 18 month contract Excellent understanding of obj

AI / ML Engineer

Shrive Technologies LLC

Remote

Contract

Role: AI/ ML - Machine Learning Engineer Location: Remote AWS, Python, Airflow, Kedro, or Luigi Hadoop, Spark, or similar frameworks. Experience with graph databases a plus. Responsibilities: Strong experience in PythonExperience in data product development, analytical models, and model governanceExperience with AI workflow management tools such as Airflow, Kedro, or LuigiExposure statistical modeling, machine learning algorithms, and predictive analytics.Highly structured and organized work pla