Skip to content
Lioncore

Tools

RAG chunker

Five splitting strategies, from a blunt fixed cut to recursive separator splitting and Markdown headings. Set the size and the overlap, see the chunks with the carried-over part highlighted, the size distribution and the token cost, then export the lot as JSON. This is where RAG quality is decided, and it is easier to judge by eye than by reading code.

Strategy

Tries the biggest separator first (blank line), then line breaks, then sentences, then words, splitting further only when a piece is still too big. The sane default: it keeps paragraphs whole whenever they fit.

chars
1008004000

The ceiling for one chunk, in characters. Small chunks retrieve precisely but lose context; large ones carry context but dilute the embedding. Between 300 and 800 suits most prose.

chars
0250500

How much of the end of a chunk is repeated at the start of the next. It stops an idea that straddles a cut from being lost by both chunks. Ten to twenty percent of the size is the usual range.

Chunks

7

Average size

321 ch

290 – 360

Est. tokens

560

whole corpus

Overhead

+79%

added by overlap

Size distribution
290 ch360 ch

A tight cluster means predictable retrieval. A long tail of tiny chunks usually means the separator is firing too often.

Chunks
#0301 ch78 tok

# Return policy Our return policy lasts thirty days from delivery. Once thirty days have gone by, we cannot offer you a refund or an exchange. To be eligible for a return, your item must be unused and in the same condition that you received it. It must also be in the original packaging. ## Refunds

#1336 ch85 tok156 ch overlap

To be eligible for a return, your item must be unused and in the same condition that you received it. It must also be in the original packaging. ## Refunds Once your return is received and inspected, we will send you an email to notify you that we have received it. We will also notify you of the approval or rejection of your refund.

#2360 ch92 tok178 ch overlap

Once your return is received and inspected, we will send you an email to notify you that we have received it. We will also notify you of the approval or rejection of your refund. If you are approved, your refund will be processed and a credit will automatically be applied to your original method of payment within seven to ten business days. ## Late refunds

#3359 ch90 tok180 ch overlap

If you are approved, your refund will be processed and a credit will automatically be applied to your original method of payment within seven to ten business days. ## Late refunds If you have not received a refund yet, first check your bank account again. Then contact your credit card company: there is often some processing time before a refund is posted.

#4290 ch69 tok177 ch overlap

If you have not received a refund yet, first check your bank account again. Then contact your credit card company: there is often some processing time before a refund is posted. If you have done all of this and you still have not received your refund, please contact us. ## Shipping costs

#5301 ch72 tok111 ch overlap

If you have done all of this and you still have not received your refund, please contact us. ## Shipping costs You are responsible for paying the shipping costs for returning your item. Shipping costs are non-refundable. If you receive a refund, the cost of return shipping will be deducted from it.

#6303 ch74 tok188 ch overlap

You are responsible for paying the shipping costs for returning your item. Shipping costs are non-refundable. If you receive a refund, the cost of return shipping will be deducted from it. Depending on where you live, the time it may take for your exchanged product to reach you may vary significantly.

1,260 chars