Big Data Architecture & Technology Concepts

COURSE FEATURES

Duration

4 Days

Skill level

All levels

Course tailored to participants' expertise.

Language

Romanian

Type

In-class / Online-live

Assessments

Yes

Custom Training

1800 Eur / Day

Open Class

850 Eur / Participant

Download PDF

The course is designed to make sure the participant will understand the usage and applicability of big data technologies like Hadoop, Spark, Cassandra, Hbase, Kafka, and which aspects to consider when starting to build a big data architecture.

This course is intended for:

– Existing architects from different other domains interested in understanding what architecting a big data solution means

– Solution responsables/engineers knowledgeable in different big data solutions (Hadoop, Spark, NoSQL solutions, ETL components, ML) that would like to understand “the big picture” of what architecting a big data solution means.

This course is taught in Romanian, with course materials available in either English, or Romanian. The course can be customized - on request.

DAY

TOPICS

Specific technologies overview and details:

Storage: NoSQL databases (random reads on data)

Overview of different NoSQL solutions

Cassandra detailed overview

Main concepts: data partitioning, distribution, replication, consistency, how to write and read data, compaction

How data is inserted / updated / deleted

Understand the main patterns and anti-patterns

Basic data modeling rules for Cassandra best performance

Use case based on Cassandra – hands on session

DAY

TOPICS

Main concepts recap

Differences to Cassandra

Main data modeling aspects: how data is best read

How to choose a noSQL solution – the considerations

Recap storage options: long term storage of immutable data (HDFS) & random writes/reads of data (Hbase/Cassandra/..).

DAY

TOPICS

Overview of different solutions : Storm, Spark , …

Distributed computations and Stream processing with Spark

Spark as ETL tool – examples and demo

Examples on using Spark and Spark streaming + demo session

Data Analysis

SQL on everything options: Hive, Impala, Spark SQL, Apache Drill

Integrate Cassandra with Spark SQL for data analytics, what kind of analytics can be performed

Hands on exercises for analytics with Spark SQL and Cassandra

Search solutions – the extra capability needed besides an SQL engine:

Overview of the capabilities of Solr, Elastic – what extra functionalities those bring to a SQL Engine solution

DAY

TOPICS

Why a messaging bus in a big data architecture?

Kafka demo in combination with Spark streaming

Clustering and Resource Management : Mesos

End to End example including Machine Learning – (we will complete/demo a noSQL + Spark app with ML)

Contact Us

Feel free to leave us your thoughts so we can discover the solution together!

academy@esolutions.ro

Get in touch

0753.029.187

Our address

20 Constantin Budisteanu Street , 1 st. District, Bucharest

academy@esolutions.ro

Get in touch

0753.029.187

Our address

20 Constantin Budisteanu Street , 1 st. District, Bucharest

Related Courses

+ View all courses

Big Data

Apache NiFi

This course covers the main concepts in Apache NiFi and its potential in automated data flow between systems, providing efficient data ingestion, transformation, and routing.

DURATION

3 Days

Big Data

Apache Storm

This course covers the main concepts in Apache Storm and its potential in use cases such as real-time analytics, continuous computation, and event-driven apps.

DURATION

3 Days

Big Data

Cassandra

This introductory course covers common use cases for Cassandra, its key features, storage architecture, and more.

DURATION

3 Days

Big Data

Data Ingestion using Apache NiFi and MiNiFi

This course provides knowledge on how to ingest data from various sources, in batch or real-time, into analytic platforms by using Apache NiFi and MiNiFi.

DURATION

2 Days

+ View all courses

Do you want to become a trainer?

Ask not what your company can do for you, ask what you can do for your company. Apply for a training position.

Apply Now