Spring Integration-2 :Adapters

-

Adapters are messaging endpoints.  In particular, they are the message endpoint that bridges your Spring Integration system to external systems and services (like JMS queues, databases, mail systems, etc.).

Adapters (aka Channel adapters)

An endpoint which connects channel to external systems

  1. It provides the bridge b/w Intregation framwork and external systems and services
  2. provides saperation of messaging concerns from transports and protocol used

Adapters are Inbound and Outbound

Inbound- Those that brings messages into Spring Integration Channels

Outbound- Those that gets messages from SI channels to outside Applications , Databases etc.

Built in Adapters

  1. Stream Adapters(like standard input and output stream adapters)
  2. File Adapters
  3. JMS Adapters
  4. JDBC and JPA Adapters
  5. FTP and Secure FTP( SFTP) Adapters
  6. Feed (RSS,Atom etc) Adapters
  7. Mail Adapters
  8. MongoDB Adapters
  9. UDP Adapters
  10. Twitter Adapters

We can create custom adapter as per application requirements.

Example Adapters:

A JMS Inbound Adapter

  • Take message from Message Queue and gets it to SI Channel.
  • Need JMS connection factory and queue configurations
  • JMS channel adapters are part of SI’s JMS Module (int-jms namespace)
  • Note that JMS pulls the messages at the poll rate
 <jms:inbound-channel-adapter id="jmsIn" connection-factory="jmsConnectionFactory" destination="inQueue" channel="exampleChannel">     <integration:poller>         <integration:interval-trigger interval="30" time-unit="SECONDS"/>     </integration:poller> </jms:inbound-channel-adapter>

A JMS Outbound Adapter

  • Take message from a Message Channel and deliver it to Message Queue (via JMS)
  • Also need JMS Queue
<jms:outbound-channel-adapter id="jmsOut" destination="outQueue" channel="exampleChannel"/>

Popular posts from this blog

Window function in PySpark with Joins example using 2 Dataframes (inner join)

-
Input details: #● File has json records #● Each record has fields: #○ user_id #○ card_num #○ merchant #○ category #○ amount #○ ts ### Below analysis to be done Sample data: +------+--------+---------+--------+----------+-------+|amount|card_num| category|merchant| ts|user_id|+------+--------+---------+--------+----------+-------+| 243| C_108| food| M_102|1579532902| U_104|| 699| C_106|cosmetics| M_103|1581759040| U_103|| 228| C_104| children| M_110|1584161986| U_103| Solution: from pyspark.sql.functions import col # this can be done without using window function creditCardData = spark.read.json(“card_transactions.json”) useridMaxSpendDF = df.groupby(‘user_id’).max(‘amount’) useridMaxSpendDF=useridMaxSpendDF.withColumnRenamed(“max(amount)”,”max_amount”) useridMaxSpendDF=useridMaxSpendDF.withColumnRenamed(“user_id”,”m_user_id”) cond = [creditCardData.user_id == useridMaxSpen...
Read more

Complex SQL: fetch the users who logged in consecutively 3 or more times (lead perfect example)

-
From the login_details table, fetch the users who logged in consecutively 3 or more times. Table Name : LOGIN_DETAILS Approach : We need to fetch users who have appeared 3 or more times consecutively in login details table. There is a window function which can be used to fetch data from the following record. Use that window function to compare the user name in current row with user name in the next row and in the row following the next row. If it matches then fetch those records. –Table Structure: drop table login_details; create table login_details( login_id int primary key, user_name varchar(50) not null, login_date date); delete from login_details; insert into login_details values (101, ‘Michael’, current_date), (102, ‘James’, current_date), (103, ‘Stewart’, current_date+1), (104, ‘Stewart’, current_date+1), (105, ‘Stewart’, current_date+1), (106, ‘Michael’, current_date+2), (107, ‘Michael’, cur...
Read more

Credit Card Data Analysis using PySpark (how to use auto broadcast join after disabling it)

-
Input details: #● File has json records #● Each record has fields: #○ user_id #○ card_num #○ merchant #○ category #○ amount #○ ts ### Below analysis to be done Sample data: +------+--------+---------+--------+----------+-------+|amount|card_num| category|merchant| ts|user_id|+------+--------+---------+--------+----------+-------+| 243| C_108| food| M_102|1579532902| U_104|| 699| C_106|cosmetics| M_103|1581759040| U_103|| 228| C_104| children| M_110|1584161986| U_103| Application: Here we will disable auto broadcast and then join 2 data frames and will see execution plan which should use broadcast join Solution: from pyspark.sql import SparkSession from pyspark.sql.functions import broadcast spark = SparkSession.builder.master(‘local[2]’)\ .appName(‘RDD_Methods_Examples’)\ .getOrCreate() print(spark.conf.get(“spark.sql.autoBroadcastJoinThreshold”)) spark.conf.set(“spark.sql.autoBroadcastJoinThreshold”, -1) pr...
Read more