right persistence technology [closed]

General Tech Technology & Software 2 years ago

0 1 0 0 0 tuteeHUB earn credit +10 pts

5 Star Rating 1 Rating

Posted on 16 Aug 2022, this text provides information on Technology & Software related to General Tech. Please note that while accuracy is prioritized, the data presented might not be entirely correct or up-to-date. This information is offered for general knowledge and informational purposes only, and should not be considered as a substitute for professional advice.

Take Quiz To Earn Credits!

Turn Your Knowledge into Earnings.

tuteehub_quiz

Answers (1)

Post Answer
profilepic.png
manpreet Tuteehub forum best answer Best Answer 2 years ago

 


We have an application server running in nodejs and we are trying to replace our current persistence technology (MySQL). We are considering several nosql options like CouchDB, MongoDB, Redis, Riak etcetera. The size of the data will not be huge (1 Gb max) and a single server solution is fine.

We are developing our own transformation/query language and for this to work efficiently, the most important requirement of our persistence technlogy is it is very fast in navigating over the datastructure; retrieve a record/document/node, look up the records it links to and then retrieve some of them. This is done recursively in 1 transformation, and a typical transfomation will recursively retrieve about a 100.00 records.

I see 3 possible solution directions

1) Use a NoSQL product as a simple key value store, don't use any of their advanced features, like aggregation, filtering etcetera (except for indexing perhaps) and send a request for every record 1 by 1.

2) Use an in process key value store (Alfred?) (I would think that this is a lot more efficient, but that's just gut feeling, no actual measuring done yet).

3) Our transformation engine is written in javascript and a transformation itself is defined as a complex JSON structure, so we might store the transformation engine as a view in a nosql product that supports Javascript (like MongoDB) and every time we want to do a transformation, we send the JSON structure and let the nosql server do the transformation.

What is the best direction/product you can think of to build this?

gr,

Coen

No matter what stage you're at in your education or career, TuteeHub will help you reach the next level that you're aiming for. Simply,Choose a subject/topic and get started in self-paced practice sessions to improve your knowledge and scores.