Hi all,
I'm writing an application that aggregate data from various sources.
Data item comes with many attributes. Users interested with the data
can create filters, to filter data based on data attributes
Example : data1 = { 'first_name':'Jimmy', 'last_name':'kurnia',
'title':'engineer', 'country':'Singapore',.... }
Say a user, user1, interested with data with these attributes :
{'country':'Singapore'} and salary > 50000
So every time a new data comes in, it has to go through all filters.
If it matches the filter, the data would be sent in real time to the
user by email
The problem : if, let say, there are 10K users, creating 10K filters,
then 1 data item has to go through 10K filter. Is this something that
can be solved efficiently using Message router pattern in Camel ?
If yes, how can I implement the solution using message router pattern
in Camel ( pseudocode or sample would be appreciated )
regards,
Chris
I'm writing an application that aggregate data from various sources.
Data item comes with many attributes. Users interested with the data
can create filters, to filter data based on data attributes
Example : data1 = { 'first_name':'Jimmy', 'last_name':'kurnia',
'title':'engineer', 'country':'Singapore',.... }
Say a user, user1, interested with data with these attributes :
{'country':'Singapore'} and salary > 50000
So every time a new data comes in, it has to go through all filters.
If it matches the filter, the data would be sent in real time to the
user by email
The problem : if, let say, there are 10K users, creating 10K filters,
then 1 data item has to go through 10K filter. Is this something that
can be solved efficiently using Message router pattern in Camel ?
If yes, how can I implement the solution using message router pattern
in Camel ( pseudocode or sample would be appreciated )
regards,
Chris