Smart devices that communicate with other smart devices, known as Internet of Things (IoT) applications, have revolutionized the modern way of life. From self-driving cars to interactive gaming, IoT ...

Stream processing systems are pivotal to modern data-driven environments, enabling the continual ingestion, processing and analysis of unbounded data streams across distributed computing resources.

It wasn’t long ago that developers looked to the Lamba architecture for hints on how to design big data applications that needed elements of both batch and streaming data. But already, the Lamba ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

This guest post comes from Neha Narkhede, co-founder and CTO at Confluent, a startup focused on Apache Kafka and founded by its creators. Data systems in the modern world aren't islands that stand on ...

In the fast-evolving world of data engineering, two methods of data analysis have emerged as the dominant, yet competing, approaches: batch processing and stream processing. Batch processing, a ...

It is easy to come out of a presentation on “big data” these days thinking that the future of manufacturing information technology (IT) is a combination of three things: connected machines, data ...

There’s more to “big data” than just lots of bits on disks. Some things you can’t just store in the raw; others you need to analyze and process before they ever hit a disk. That way they can be acted ...