Spring Batch

Filed Under: Spring

The world is moving very fast with the existence of technology. Enterprises and Corporations want to perform tasks faster and more accurately. The processing of such data includes daily report generation, processing bulk data without human intervention. Spring batch is the solution to most of these tasks. It enables processing of bulk data in a transactional manner and performs day to day activity with precision and speed.

Spring Batch

  • Spring batch is based on spring framework and is very lightweight. The core concept of spring batch as the name suggests is processing of data in batches.
  • It is based on OOPS concepts and uses POJO based development.
  • Spring Batch provides advance services and features for high volume and high performance batch jobs using optimization and partitioning techniques. It is highly scalable and can be used for processing of high amount of data.
  • It is not a scheduler and should be used in conjunction with a scheduler.

Why do we need Spring Batch?

Let us go back into the history for looking into the need for spring batch.

While open source software projects and open source communities have majorly focused on web-based and messaging-based architecture frameworks, the reusable architecture frameworks took a back seat to accommodate Java-based batch processing needs, considering the continuous need to handle such processing on a daily basis within the enterprise.

The lack of a standard, scalable and reusable batch architecture resulted in the development of many in-house solutions from various companies.

SpringSource and Accenture collaborated to create something more standard and reusable. Having the proven technical experience in implementing batch architectures, SpringSource’s depth of technical experience and spring’s proven programming model together made a powerful architecture to create high-quality, market-relevant software aimed at filling an important gap in enterprise Java.

Accenture contributed with previous proprietary batch processing architecture frameworks to the Spring Batch project along with support team, enhancements, and the future roadmap.

Spring Batch Usage

A batch program reads a large number of records from a database, file, or queue, processes the data based on the business needs, and then writes back data in the desired form.

Spring Batch automates this basic batch iteration, providing the capability to process similar transactions as a set, all this can be done in an offline environment without any user interaction.

Batch jobs are part of most IT projects and Spring Batch is the only open source framework that provides a robust, enterprise solution.

Let us look at some of the real-time usages of spring batch both business wise and technical.

Spring Batch Business Use Case

  1. At the end of a month when a company has to send salary to its employee’s respective accounts.
  2. Processing of salary slips at month end is when spring batch can be used.
  3. Sending out mass communication emails.
  4. For generating automated reports on daily, weekly or monthly basis.
  5. Executing business workflow automatically without human intervention.

Spring Batch Technical Use Cases

  1. For automatic test execution at a defined frequency.
  2. This can be used for doing automatic database updates on a predefined frequency.
  3. It can be used with a queue system to handle huge amount of transactions without any failure.
  4. Spring batch can be used along with APIs to perform tasks such as health check for server or application, dummy data generation for load test, etc.

Spring Batch Architecture

The diagram below shows the technical architecture of Spring Batch.

Spring Batch Architecture

  1. Application: This contains all the batch jobs and code written by the developer based on business needs.
  2. Batch Core: It contains the runtime classes necessary to run a batch job. The classes such are JobLauncher, Job and Step implementation are part of the Batch Core.
  3. Batch Infrastructure: This contains the reader and writer services which are used by developer and the framework itself. The classes are ItemReader and ItemWriter. It also contains services to retry read and write.

Spring Batch Processing

A regular spring batch processing workflow is shown below.

spring batch processing

  1. In the workflow shown, the data is read from database using reader which is part of the Spring Batch.
  2. Then the data is passed to processor for processing the data based on the business requirement.
  3. The processed data which is now modified data is passed to the writer, which writes the data back into the database.
  4. The source of data can be Database, file, queue etc.

Spring Batch Advantages

Let’s see the advantages of using Spring Batch processing.

  • Developers can concentrate on implementation of business logic and framework will take care of the iterations.
  • Since it is a layered architecture the decoupling between different layers is easy.
  • You can implement a core business logic that can be used as generic implementation throughout the application.
  • It provides separation between infrastructure and application at the JAR level as well resulting in easy and scalable deployment.

That’s all for a quick introduction of Spring Batch.

Please head over to Spring Batch Example to learn how to implement Spring Batch in your applications.

Reference: Project Official Page

Comments

  1. Chandra Verma says:

    @pankaj, good to read this page. I followed you blog for couple times. As general feedback spend some time to consolidate material which are generally useful and feel like technical document. After reading this page its just gives me 100K foot picture of Spring Batch no code no uses case …. ( doesnt look like technical journal)

    1. Pankaj says:

      The post was going too long, so I had split it into two parts – one for the theory that you have already read here. Next part is for complete example:

      https://www.journaldev.com/17157/spring-batch-example

      Sorry, I forgot to include the link at the end of the post, I have updated the post now.

  2. Vinoth says:

    Hi,

    Good introduction.

    Can you write example of tasklet and chunk based batch jobs using spring batch 4?

Leave a Reply

Your email address will not be published. Required fields are marked *

close
Generic selectors
Exact matches only
Search in title
Search in content
Search in posts
Search in pages