Big Data Engineer Jobs in Boston, MA

Refine Results
1 - 20 of 268 Jobs

Big Data Engineer

Diamond Pick

Remote

Contract

POSITION SUMMARY: The Big Data Engineer is responsible for designing and developing data pipelines, ensuring efficient data processing, and maintaining data infrastructure. They work with large-scale data sets, implement ETL (Extract, Transform, Load) processes, and collaborate with cross-functional teams to meet business needs. RESPONSIBILITIES: Designing and Building Data Pipelines Develop and maintain data processing pipelines using Python, PySpark, and Big Data technologies (e.g., Dataproc

Big Data Engineer

ADDSOURCE

Remote

Third Party

Role: Bigdata Developer Exp Required: 12+Years Location: Remote Mandatory Skills: Spark, Scala EMR and AWS Job Description Bachelor's degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployme

AWS Glue Big data engineer

System Soft Technologies

Remote

Contract

System Soft Technologies is widely recognized for its professionalism, strong corporate morals, customer satisfaction, and effective business practices. We provide a full spectrum of business and IT services and solutions, including custom application development, enterprise solutions, systems integration, mobility solutions, and business information management. System Soft Technologies combines business domain knowledge with industry-specific practices and methodologies to offer unique solution

Bigdata Hadoop Engineer

Softsol Resources Inc

Remote or California City, California, USA

Contract

Please send me your resume to if you are interested and can be able to work on W2. Need local to California Job Title: Hadoop Engineer- CR243 Location: Remote but looking local to California. Duration : Long Term Job Description: MUST Have SKILLS. Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must. Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must. 4-5 experience building data pipelines using Hadoop components Sqoop, Hive, S

Senior Scala Software Engineer

JBC powered by Workgenius

Remote

Contract

Senior Software Engineer (Java / Scala) with Top Mass Media & Entertainment Company Senior Software Engineer (Java / Scala) Location: Remote Rate: up to $88.00/HR W2 Duration: 18 months Summary: The Ad Intelligence team is under Ad Platforms and its mission is to transform advertising and the Ad platform with data and AI across TV and streaming video. We build solutions to measure and optimize every aspect of the advertising life cycle. Our tenant is a strong cross-domain team to deliver E2E sol

Big Data Engineer - (Remote / Only for W2)

Primus Software Corp

Remote

Contract

Job Title: Big Data Platform Development Engineer Duration: 6 - 7+ months Contract Possibility of extension Locations: Remote - Texas *Only W2 Candidates* Discription: You will evolve the data cloud platform and building pipelines that are scalable, robust and resilient, to validate, ingest, normalize/enrich and support business rule processing of data. You will provide leadership in big data and cloud technologies. 5+ years of experience with Big Data pipelines with Spark in Java, Scala, Pyth

Cloud Engineer (Machine Learning Ops)

Dexian DISYS

Boston, Massachusetts, USA

Contract

Position Details: Title: Cloud Engineer (Machine Learning Ops) Location: 1 Week Onsite , 3 Weeks Remote - Boston, MA Local Boston MA candidates only The Expertise You Have Has Bachelor's or Master's Degree in a technology related field (e.g. Engineering, Computer Science, etc.). Experience in Object Oriented Programming (Java, Scala, Python), SQL, Unix scripting or related programming languages and exposure to some of Python's ML ecosystem (numpy, panda, sklearn, tensorflow, etc.). Experience i

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin

Sr Data Engineer

The Connors Group, Inc.

Remote

Full-time

The Senior Engineer is responsible for the design, development, implementation and support of ELT processes for Data Platform. Works as part of a team to develop data pipelines, data transformation logic in ADF, python or Scala and other technologies to move data from a variety of operational platforms into Azure cloud. Conduct performance tuning of ELT processes for large and medium volumes of data, develop and oversee monitoring systems to ensure data loads complete on schedule and data is acc

Sr. Big Data Architect

TeknoBit Solutions Inc.

Boston, Massachusetts, USA

Full-time, Third Party

Role: Sr. BIG Data Solutions Architect Responsibilities: Deep expertise in Big Data, data warehouse, data analytics projects, and/or any Information Management related projectsPrior experience building large scale enterprise data architectures using commercial and/or open source Data Analytics technologiesFacilitate the establishment and execution of the roadmap and vision for information delivery and management; including the enterprise data warehouse, big data, BI & analytics, content managem

Data Engineer II

The Connors Group, Inc.

Remote

Full-time

The Data Engineer II plays a critical role in engineering of data solutions that support the reporting and analytic needs. As a key member of the Data engineering team, will work on diverse data technologies such as Steramsets, dbt, data ops and others to build insightful, scalable, and robust data pipelines that feed our various analytics platforms. ESSENTIAL FUNCTIONS: Design and Model data engineering pipelines that support company reporting and analytic needs. Engineer efficient, adaptable,

Big Data Modeler / Architect (FX Domain)

Sysmind, LLC

Boston, Massachusetts, USA

Full-time, Contract, Third Party

Role: Big Data Modeler / Architect (FX Domain) Location: Boston, MA Role Description: The team is involved in the build-out of a Data Lakehouse using Databricks for the FX business line. They are setting up the Databricks infrastructure and soon will start building ingestion pipelines into the Bronze Zone. Additionally, they will design the data model for the Silver Zone and handle data migration from Bronze to Silver. The candidate must be a senior data professional with expertise in building

Azure Data Engineer

Princeton IT Services

Boston, Massachusetts, USA

Contract

Job Title: Azure Data Engineer Location: Boston, MA Role Type: Contract Role Overview: We are seeking a highly skilled Azure Data Engineer with expertise in data migration from Big Data platforms to Azure Data Factory (ADF) to join our team. The ideal candidate will have a strong background in designing and executing complex data migration projects, with a focus on leveraging Azure cloud technologies. As an Azure Data Engineer, you will play a key role in migrating data from various Big Data

Senior Software Engineer - ModBus, DNP3, .NET [REMOTE]

Technology Navigators

Remote

Full-time

No sponsorship. No third-party/C2C candidates. Senior Software Engineer C#, .NET Core, PostGres, Modbus, DNP3 REMOTE, must reside in Texas Salary: 120-135K DOE Benefits: Medical, Dental, and Vision Insurance, Flexible Spending Account, Long and Short term Disability, 401K Match, Unlimited PTO *This is an exclusive, off-market opportunity. Our client searches are confidential.* Apply now to learn more about this unique new position! What you get to do: Operate independently in a distributed team

AI / ML Engineer

Shrive Technologies LLC

Remote

Contract

Role: AI/ ML - Machine Learning Engineer Location: Remote AWS, Python, Airflow, Kedro, or Luigi Hadoop, Spark, or similar frameworks. Experience with graph databases a plus. Responsibilities: Strong experience in PythonExperience in data product development, analytical models, and model governanceExperience with AI workflow management tools such as Airflow, Kedro, or LuigiExposure statistical modeling, machine learning algorithms, and predictive analytics.Highly structured and organized work pla

Application Engineer - Data

Mass Mutual Financial Group

Boston, Massachusetts, USA

Full-time

What great looks like in this role Our ideal candidate is someone who enjoys designing, building and delivering complex systems. You love coding and revel in finding elegant solutions to difficult problems. You understand the challenges of handling data at scale and are always looking for opportunities to leverage open-source tools to accelerate development. You are passionate about learning new technologies, are team orientated and a strong communicator. Objectives of the role Design, develop

Sr Scala Developer

TechLink Resources

Remote

Contract

NO H-1B ONLY W2 1. looking for hands-on developers at the moment, not Architect. Must be passionate about Scala programing. 2. OOD programming background is important, but should be big data related 3. Data analyst, data scientist and researcher are NOT the right candidates Responsibilities: Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needs Build next-gen cloud based big data infrastructure f

Software Quality Automation Engineer, Officer

State Street Corporation

Quincy, Massachusetts, USA

Full-time

Who we are looking for The Software Quality Automation Engineer will play a key role in the quality assurance of AML Transaction Monitoring suite of applications. We are looking for someone who has proven experience with testing and automating complex applications. This role will be responsible for defining and maintaining an acceptance testing cycle that is common in an Agile process including automation. Candidate will be expected to attend daily scrum ceremonies and required to attend meetin

Senior Data Scientist

UKG Careers

Lowell, Massachusetts, USA

Full-time

Company Overview Here at UKG, our purpose is people . Our HR, payroll, and workforce management solutions help organizations unlock happier outcomes for all. And our U Krewers, who build those solutions and support our business, are talented, collaborative, and innovative problem-solvers. We strive to create a culture of belonging and an employee experience that empowers our people - both at work and at home. Our benefits show that we care about the whole you, from adoption and surrogacy assist

Senior Lead Data Engineer

Capital One

Boston, Massachusetts, USA

Full-time

Center 2 (19050), United States of America, McLean, Virginia Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging