WinWire > Case Studies > A Leading American Multinational Software Firm

A Leading American Multinational Software Firm

WinWire Logo
 A Leading American Multinational Software Firm - IoT ONE Case Study
The Challenge

The customer had embarked on a multiyear initiative focused on moving their Big Data platform from Cloudera Hadoop On-Prem instance to Cloudera Data Platform (CDP) on Azure. As a first step, they wanted to explore the prioritized MapReduce jobs in the current state and consider migration to Spark before moving the workloads to Azure Cloud.

They had initially created a solution with Hadoop Map Reduce engine and Hive Queries (HQL). The current setup had the following challenges: 

  1. Slower code execution speed
  2. Higher storage requirement
  3. Difficult to maintain workflows
  4. The newer solution they envisioned should address all issues mentioned above and wanted a revamped approach to processing Big Data. They were looking for a partner that could support them in converting identified MapReduce Jobs to Spark as they wanted to reduce the execution and processing time of Jobs as it was impacting their business performance.
  5. Eventually, it will enable them to move their Big Data platform from Cloudera Hadoop On-Prem instance to Cloudera Data Platform (CDP) on Azure. 
The Customer

American multinational computer software company

About The Customer

The customer is an American multinational computer software company with game-changing innovations that are redefining the possibilities of digital experiences. The customer connects content and data and introduces new technologies that democratize creativity, shapes the next generation of storytelling, and inspire new categories of business.

The Solution

WinWire, in collaboration with the customer, has taken two prioritized jobs [LTV & AES] to convert MapReduce jobs to Spark. These were categorized as high-complexity jobs.

WinWire team transitioned MapReduce code to Spark code seamlessly. This transition enabled the customer to process data faster and improve the overall performance of the job by reducing the executing time by more than 50%.

Technologies used: Hive, Spark -2.4, Scala – 2.11, IntelliJ Idea Community Edition – 2021.1, Unravel, Hive Shell, Spark2-shell, CDH – 5.16, GitHub

Case Study missing?

Start adding your own!

Register with your work email and create a new case study profile for your business.

Add New Record

Contact us

Let's talk!
* Required
* Required
* Required
* Invalid email address
By submitting this form, you agree that IoT ONE may contact you with insights and marketing messaging.
No thanks, I don't want to receive any marketing emails from IoT ONE.
Submit

Thank you for your message!
We will contact you soon.