Practical Hadoop Migration

How to Integrate Your RDBMS with the Hadoop Ecosystem and Re-Architect Relational Applications to NoSQL

Author: Bhushan Lakhe

Publisher: Apress

ISBN: 1484212878

Category: Computers

Page: 305

View: 5423


Re-architect relational applications to NoSQL, integrate relational database management systems with the Hadoop ecosystem, and transform and migrate relational data to and from Hadoop components. This book covers the best-practice design approaches to re-architecting your relational applications and transforming your relational data to optimize concurrency, security, denormalization, and performance. Winner of IBM’s 2012 Gerstner Award for his implementation of big data and data warehouse initiatives and author of Practical Hadoop Security, author Bhushan Lakhe walks you through the entire transition process. First, he lays out the criteria for deciding what blend of re-architecting, migration, and integration between RDBMS and HDFS best meets your transition objectives. Then he demonstrates how to design your transition model. Lakhe proceeds to cover the selection criteria for ETL tools, the implementation steps for migration with SQOOP- and Flume-based data transfers, and transition optimization techniques for tuning partitions, scheduling aggregations, and redesigning ETL. Finally, he assesses the pros and cons of data lakes and Lambda architecture as integrative solutions and illustrates their implementation with real-world case studies. Hadoop/NoSQL solutions do not offer by default certain relational technology features such as role-based access control, locking for concurrent updates, and various tools for measuring and enhancing performance. Practical Hadoop Migration shows how to use open-source tools to emulate such relational functionalities in Hadoop ecosystem components. What You'll Learn Decide whether you should migrate your relational applications to big data technologies or integrate them Transition your relational applications to Hadoop/NoSQL platforms in terms of logical design and physical implementation Discover RDBMS-to-HDFS integration, data transformation, and optimization techniques Consider when to use Lambda architecture and data lake solutions Select and implement Hadoop-based components and applications to speed transition, optimize integrated performance, and emulate relational functionalities Who This Book Is For Database developers, database administrators, enterprise architects, Hadoop/NoSQL developers, and IT leaders. Its secondary readership is project and program managers and advanced students of database and management information systems.

Information Systems Architecture and Technology: Proceedings of 39th International Conference on Information Systems Architecture and Technology – ISAT 2018

Author: Leszek Borzemski

Publisher: Springer

ISBN: 3319999818


Page: 378

View: 1401


This three-volume set of books highlights major advances in the development of concepts and techniques in the area of new technologies and architectures of contemporary information systems. Further, it helps readers solve specific research and analytical problems and glean useful knowledge and business value from the data. Each chapter provides an analysis of a specific technical problem, followed by a numerical analysis, simulation and implementation of the solution to the real-life problem. Managing an organisation, especially in today’s rapidly changing circumstances, is a very complex process. Increased competition in the marketplace, especially as a result of the massive and successful entry of foreign businesses into domestic markets, changes in consumer behaviour, and broader access to new technologies and information, calls for organisational restructuring and the introduction and modification of management methods using the latest advances in science. This situation has prompted many decision-making bodies to introduce computer modelling of organisation management systems. The three books present the peer-reviewed proceedings of the 39th International Conference “Information Systems Architecture and Technology” (ISAT), held on September 16–18, 2018 in Nysa, Poland. The conference was organised by the Computer Science and Management Systems Departments, Faculty of Computer Science and Management, Wroclaw University of Technology and Sciences and University of Applied Sciences in Nysa, Poland. The papers have been grouped into three major parts: Part I—discusses topics including but not limited to Artificial Intelligence Methods, Knowledge Discovery and Data Mining, Big Data, Knowledge Based Management, Internet of Things, Cloud Computing and High Performance Computing, Distributed Computer Systems, Content Delivery Networks, and Service Oriented Computing. Part II—addresses topics including but not limited to System Modelling for Control, Recognition and Decision Support, Mathematical Modelling in Computer System Design, Service Oriented Systems and Cloud Computing, and Complex Process Modelling. Part III—focuses on topics including but not limited to Knowledge Based Management, Modelling of Financial and Investment Decisions, Modelling of Managerial Decisions, Production Systems Management and Maintenance, Risk Management, Small Business Management, and Theories and Models of Innovation.