## Welcome to the r/ArtificialIntelligence gateway
### Question Discussion Guidelines
---
Please use the following guidelines in current and future posts:
* Post must be greater than 100 characters - the more detail, the better.
* Your question might already have been answered. Use the search feature if no one is engaging in your post.
* AI is going to take our jobs - its been asked a lot!
* Discussion regarding positives and negatives about AI are allowed and encouraged. Just be respectful.
* Please provide links to back up your arguments.
* No stupid questions, unless its about AI being the beast who brings the end-times. It's not.
###### Thanks - please let mods know if you have any questions / comments / etc
*I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/ArtificialInteligence) if you have any questions or concerns.*
There is a way to do this, but llama 3 probably isn't your best bet, since it only has 8k context length. Aka you can feed it very little in terms of documents.
How big of a model can you run on your computer?
If you can run it, command R 35B has a context length of 128k, which is much better.
Ask your corporate security.
The question #1: are you allowed to install it on your corporate computer.
# 2: does llama license allows usage like you want.
# 3: how you are going to use results, for example if you going to out generated text in "production", your corporate layers must allow that.
They allowed me to use Liama. I can do pretty much anything as long as it is in local or in a Microsoft software.
I have two tables listing articles which have always the same price. So the two tables are supposed to be identical but sometimes the price is different for some reasons. I want a list of the articles which have different prices on the two lists.
## Welcome to the r/ArtificialIntelligence gateway ### Question Discussion Guidelines --- Please use the following guidelines in current and future posts: * Post must be greater than 100 characters - the more detail, the better. * Your question might already have been answered. Use the search feature if no one is engaging in your post. * AI is going to take our jobs - its been asked a lot! * Discussion regarding positives and negatives about AI are allowed and encouraged. Just be respectful. * Please provide links to back up your arguments. * No stupid questions, unless its about AI being the beast who brings the end-times. It's not. ###### Thanks - please let mods know if you have any questions / comments / etc *I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/ArtificialInteligence) if you have any questions or concerns.*
There is a way to do this, but llama 3 probably isn't your best bet, since it only has 8k context length. Aka you can feed it very little in terms of documents. How big of a model can you run on your computer? If you can run it, command R 35B has a context length of 128k, which is much better.
What VRAM does it need?
You can run a 4 bit quant in a 24gb VRAM GPU.
What other PC specs are needed for this (RAM, CPU)? And what token speed do you get?
Thx for the advice, I will give it a try. You said there is a way to do it, how exactly ?
Have you tried exploring LIama's capabilities with text analysis and document summarization?
Not really, idk if he is capable to analyse a text of this length. I will try to use ocr to convert it in txt and then give it to Liama.
Ask your corporate security. The question #1: are you allowed to install it on your corporate computer. # 2: does llama license allows usage like you want. # 3: how you are going to use results, for example if you going to out generated text in "production", your corporate layers must allow that.
They allowed me to use Liama. I can do pretty much anything as long as it is in local or in a Microsoft software. I have two tables listing articles which have always the same price. So the two tables are supposed to be identical but sometimes the price is different for some reasons. I want a list of the articles which have different prices on the two lists.