Produce Section of a Large Food Supermarket
How one big retail chain moved its data warehouse to a Hadoop environment.
Name of Organization: Impetus Technologies
Industry: Retail
Opportunity or Challenge Encountered: Impetus was contacted by a U.S.-based multinational retail chain to batch-migrate its data warehouse from Teradata to a Hadoop/Hive environment. Batch migration includes data storage, the creation of batch jobs, moving migrated data to target systems, performing data validation, conversion of Teradata specific operations to new systems and training assistance.
See also: Case Study: Building the Refinery of the Future with IoT
How this Opportunity or Challenge Was Met: Impetus developed a two
key migration solution for the retail chain. One-time migration of historical
data from Teradata, scripts and queries used in batch and ad-hoc to access
Teradata and analytical post-processed data was all moved onto the new Hadoop
environment. Incremental migration of daily, weekly, and monthly increments of
data from source to Hadoop. Impetus’ solution features an automated utility
that converts BTEQ and SQL scripts into SparkQL/HiveQL equivalent, reducing the
time it takes to migrate drastically. Impetus used its Workload Migration and
IBM DataStage for incremental data migration to Hadoop.
Benefits of This Initiative: The migration to Hadoop reduces the overall cost of running the data warehouse, moves to a modern technology that is more easily accessible to basic users and adds business risk mitigation. Teradata’s high licensing cost and high barrier to entry are two reasons we see a surge in migration interest to Apache’s platforms, which are open source and updated more frequently.
David is a technology writer with several years experience covering all aspects of IoT, from technology to networks to security.
Best Practices for Deploying and Scaling Industrial AIArtificial Intelligence (AI) is transforming industrial operations, helping organizations optimize workflows, reduce downtime, and enhance productivity. Different industry verticals leverage AI in unique ways.Link to The Center for Adaptive Edge Intelligence
The Center for Adaptive Edge IntelligenceAdaptive edge intelligence brings real-time decision-making to the point of data creation, whether from sensors, machines, or cameras.Link to The Value of Vehicle Electrification
The Value of Vehicle ElectrificationElectric vehicles (EVs) present automakers with many design, engineering, and manufactu ring challenges.Link to Accelerating Manufacturing Digital Transformation with Industrial Connectivity and IoT
Accelerating Manufacturing Digital Transformation with Industrial Connectivity and IoTDigital transformation is empowering industrial organizations to deliver sustainable innovation, disruption-proof products and services, and continuous operational improvement.Link to Smart Manufacturing for Automotive
Smart Manufacturing for AutomotiveLeading a transportation revolution in autonomous, electric, shared mobility and connectivity with the next generation of design and development tools.Link to Center for Data Pipeline Automation
Center for Data Pipeline AutomationAs businesses become data-driven and rely more heavily on analytics to operate, getting high-quality, trusted data to the right data user at the right time is essential.Link to Center for Automated Integration
Center for Automated IntegrationThe goal of automated integration is to enable applications and systems that were built separately to easily share data and work together, resulting in new capabilities and efficiencies that cut costs, uncover insights, and much more.Link to Continuous Intelligence: Insights
Continuous Intelligence: InsightsDigital transformation requires continuous intelligence (CI). Today’s digital businesses are leveraging this new category of software which includes real-time analytics and insights from a single, cloud-native platform across multiple use cases to speed decision-making, and drive world-class customer experiences.
