Quantcast
Channel: Apache Timeline
Viewing all articles
Browse latest Browse all 5648

Message router pattern : is this the best way to solve thousands of filter problem ?

$
0
0
Hi all,

I'm writing an application that aggregate data from various sources.
Data item comes with many attributes. Users interested with the data
can create filters, to filter data based on data attributes

Example : data1 = { 'first_name':'Jimmy', 'last_name':'kurnia',
'title':'engineer', 'country':'Singapore',.... }

Say a user, user1, interested with data with these attributes :
{'country':'Singapore'} and salary > 50000

So every time a new data comes in, it has to go through all filters.
If it matches the filter, the data would be sent in real time to the
user by email

The problem : if, let say, there are 10K users, creating 10K filters,
then 1 data item has to go through 10K filter. Is this something that
can be solved efficiently using Message router pattern in Camel ?

If yes, how can I implement the solution using message router pattern
in Camel ( pseudocode or sample would be appreciated )

regards,
Chris

Viewing all articles
Browse latest Browse all 5648

Trending Articles