Suggestion technology/design on this BIGDATA usecase

manpreet Best Answer 2 years ago

I am new to big data technologies and design so looking for help from java world.

I have concept of tag/tags">tags and tagcombinations. For example U.S.A and Pen are two tag/tags">tags AND if they come together in some tag/definition">definition then tag/register">register a tagcombination(U.S.A-Pen) for that..

tag/tags">tags (U.S.A, Pen, Pencil, India, Shampoo) tagcombinations(U.S.A-Pen, India-pencil, U.S.A-Pencil, India-Pen, India-Pen-Shampoo)

• millions of tag/tags">tags
• billions of tagcombinations
• one tagcombination generally have 2-8 tag/tags">tags....
• Every day we get lakhs of new tagcombinations to write
• daily crores of queries to find matching combination by set of tag/tags">tags

Query need to support : one tag or set of tag/tags">tags appears in how many tagcombinationids ???? If i query for Pen,India then it should return two tagcombinaions (India-Pen, India-Pen-Shampoo))..Query will be fired by tag/application">application in realtime.

Please suggest a solution which is distributed with java client and can handle scale of data i am looking for..

Already tried on cassandra but not able toconclude that as right match for my problem..

Thanks Naresh