Sillytavern top p reddit. That was from a tip I read a bit ago.
Sillytavern top p reddit SillyTavern is a ST's default preset has a temperature of 0. SillyTavern is a fork of TavernAI 1. Try dynatemp/smoothing factor. Dynamic Temperature and min_p do not make a huge difference in my experience, but if you have great sampler settings, please let me know. Turn it off completely(1. Make sure ChatGPT 3. Top-up should always stay at 1. com. Everything else is at the default values for me. Once you have connected to one of these backends, you can control XTC from the parameter window in SillyTavern (which you can open with the top-left toolbar button). 1 This will enable Mirostat (assuming you’re using ooba with llamacpp or koboldcpp) and will ignore all A follow up: Samplers like Top K are the most effective at dumbing the model down and running it into a corner repeatedly. 256, top p 0. true. It could as simple as "this model works better with high temperatures" or maybe setting min_p higher will remove the garbage. Top K; 10. 1 and XTC Probability to 0. I've found that the CFG scale matters quite a bit, though. Oddly enough, my best roleplay experiences have been that way. I'm currently at 0 minimum and 4 maximum or 0. 812, Slope 4. | The Avakin team does not offer Support via The Poe bot(Now assistant), claude and gpt are good, gpt have a filter for NSFW but you can easily jaibreak it, claude is top tier for storytelling(in my opinion) and the rest are good with chatting and welp, all of them are good with rp, also, if you manage to "pissed off" the bot, rest assure it won't ban you, i tried, it just give me a warning but then it will calm down Personally, I do a lot of testing, so to make any meaningful comparisons, I need deterministic settings to reduce the number of variables and eliminate randomness as much as possible, so I use the Deterministic preset (temperature 0, top_p 0, top_k 1) most of the time. 05 or 0. What happen when the same setting has View community ranking In the Top 10% of largest communities on Reddit. Start with only smoothing and then add stuff and see how it affects the replies to the same prompt. 4. just because you avoid clumsy chat-to-text prompt conversion. 1 on the third one (forgot the name). So, Get the Reddit app Scan this QR code to download the app now. 70. 6 temperature. Temperature is too low: set it at 1. Pretty much like that, i have several months worth of experience in this world of Ai and sillytavern, and i have enjoyed some of it but most of it has been shooting in the dark and been somewhat frustrated, because i am illiterated on the fine Increase if it is 1. 45 users here now. Usually you can get a free trial of $5 worth of tokens. 9 Top A: 0. Now that SillyTavern is open, Change your socket in SillyTavern from Kobold to Poe and Download Kiwi Browser from the playstore. range and top p higher. Set the value to 1 to disable its effect. 6 and Top P=0. Or check it out in the app stores TOPICS A place to discuss the SillyTavern fork of TavernAI. 05 - 1. Top K of 50 would work wonders on 70B, but would result in severe brain damage on 7B. Since Miqu seems to be one of the best models currently, I'd like to try it to its full potential. Lowering Top P Parameter a bit could help with that. 98. pen. keep in mind, all of these ai's are still a work in progress and aren't going to run perfectly :) Nope. Reply to this post with the dumbest/messed up thing you can think of that you’d want to see in volumes 10-12, but the top reply to yours has to figure out how it makes sense. What is the best settings to use for sillytavern? Any advice? Technical Question Share Add a Comment. 8 Top-P, 0. 0 Currently using it with a Dorothy Franks card I exported from character AI (yep you heard it right, with CAI tools ofc) and adds some extra definition to make the card better, so far I'm having a blast writing a small bestiality scenario with this card The home of Hi I need some help I'm using Openrouter's API to use alpindale's Goliath120B model for my own RP purposes (because obviously can't host that beast locally). 02, and DRY at 0. I've had 11 mfs talking and their personalities never merged. 9 Rep. I'm finding it pretty difficult to find good resources out there on the BEST settings for this model (temp, top_p, frequency_penalty, etc. Mirostat or top p/k and temp settings might setting it into something more coherent. Right now my settings are to have every sampler neutralized except Min_P at 0. The number of tokens chosen from the most likely options is automatically determined based on the likelihood distribution of the options, but instead of choosing the Top P or Top K tokens, it chooses all tokens with probabilities above a certain threshold. I am Hi all! Currently contiplating between silly tavern local or a paid subscription to (idk which). And of course, above all, what is most important is using a good model, and configuring SillyTavern well to I always struggle to get the right settings for models. View community ranking In the Top 10% of largest communities on Reddit. Much more powerful than Freq. 44, rep penalty 1. Pre-made JSONs work great in Silly Tavern for Mixtral, but I can't seem to get it just right for Miqu, especially when messing with the temperature settings, etc. **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with Min P: Sets the minimum probability for a word to be chosen. 01-. The charge is based on tokens, with 1000 tokens = ~500 - 750 words. e. Set the value to 0 to disable its **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. 1 - I didn't liked v2, and haven't tested v2. 9, the model can only select from the tokens that are in the top 90% of probability to go next, at 0. Top P: 0. i've been using it for a while, and have had no problems! sometimes the characters or the ai in general freaks out a bit and reacts differently then normal. I always have trouble remembering how it exactly works, but if you select 0. At 0. 4-1. 7 Samplers Order: Repetition Penalty Top K Top A Tail Free Sampling Typical Sampling Top P Temperature CPU and RAM: i7-9750H, 16GB GPU: GTX 1660 Ti (6GB) The DRY sampler by u/-p-e-w-has been merged to main, so if you update oobabooga normally you can now use DRY. 05, temperature at 1. Maybe 0. Honestly, I've been disappointed by venus ai. 02. 8 which is under more active development, and has added many major features. P. I disagree on mixtral not being able to do group chats extremely well. 75 Top K: 90 Rep pen slope: 0 Reply reply More replies. I get feeling weird about ERP with a Google chatbot but I can guarantee that they already know about all your weird porn interests I've heard great things about this model, so I decided to try it through the InfermaticAI subscription, but I feel like I dont have the settings quite right yet. 5 turbo is $. the most important i think its the one of the 'top P' because if you have it at 1 it probably wont work. The official Onshape Reddit community dedicated to providing help to Onshape CAD users in need and to cultivate discussions about the Onshape system. If the V2 card can download at all (Sometimes it doesn't, which is a Chub issue that I don't fully understand), then default to getting that. But besides these basics, I haven't touched any of the other options in SillyTavern or oobabooga. com/ Install and how to guide: http://sillytavernai. The community for Old School RuneScape discussion on Reddit. it's killing me. Top p = At 1, the model can select any token to go next. In the "AI Response Configuration" tab (three horizontal sliders, at the top left of SillyTavern), if you scroll down to the bottom of the window that opens on the left, you can just copy/paste the prompt into Main prompt, though I recommend doing a 'Save As' and renaming the preset first, copy/paste the prompt, then "Save" again just to ensure I'm at Scroll tier, go for Blook-Kayra then adjust these: 575 context, 1. To test beam search we first need to agree on the type of beam search tested, in additional to the benchmark data and scoring. r/2007scape. When you see the file path showing 'Termux > SillyTavern', then you can tap the big blue 'Use this folder' button below. If you see a "Samplers Order" section, make sure that Min **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. 02 and 0. Try updating or even better - clean installing the backend you're using and the newest Silly Tavern build. You might have to press the three lines at the top right and select Termux that way. In chat mode, however, my best experiences have been with well-defined characters. ) Top 5% Rank by size . Lowering the presence penalty means the AI is more likely to repeat the same phrases. That is why Top K sampler settings are INCOMPATIBLE between different model sizes. In theory could be a decent enough model with some tuning. More posts you may like r/snowflake. 00. Mixtral-Default: - Temperature: 1. My optimal number is 2, but your settings are different from mine, so yours might be different. I have imported the recommended settings from the discord server of InfermaticAI, but I still have to change the Top K and Top P myself, because else the model wont work. 7 or lower. Added benefit is that you can fully customise the SillyTavern console to make it more distinguishable (colors, icon, etc). 8 or 0. Or check it out in the app stores A place to discuss the SillyTavern fork of TavernAI. In your SillyTavern settings (where temperature and top p and those are) scroll down to Mirostat and enable it. 4 temp, 1. 002 for every 1000 tokens. Note, a version (newest?) of llama. 5009, presence 0. You can imagine that 7B models have less tokens than 70B models by at least 10x times. Maybe use 0. 1 is great for these models, then for Dynamic Temp, just play around with it. top K: 100 top P: 0. 05-0. Followed closely by yi34b and variants, particularly nous and Get the Reddit app Scan this QR code to download the app now. It started development in late 2014 and ended June 2023. Get an ad-free experience with special benefits, and directly support Reddit. I like 0. I recommend just using Hermes 3 405b free through openrouter (if/when it stops # Top P. 20b models are acceptable but slower with less context. I currently have a 4070 with 32Gb of Ram (maybe upgrading to 64 in 2024), 7b and 13b models are running smooth with good context size. 02 (Only keeps tokens at least 1/50th as probable **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. 96, then system prompt. In my own experience and others as well, DRY appears to be significantly better at preventing repetition compared to previous samplers like repetition_penalty or no_repeat_ngram_size. Temperature makes the AI more/less predictable with their messages. A Reddit community dedicated to The Elder Scrolls Online, an **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. 92 Top A: 0 Top K: 80 Typical Sampling: 1 Tail Free Sampling: 0. To see over time. If you want your character to be particularly I normally just go with temperature 1. The default "disabled" value for those settings are: 0, 1, 1, 0. The weekend can't come soon enough for more time to play with all the new stuff! **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Fixed BG top bar icon being on top of moving UI blocks. Top P; 0. Make a note of the sampler settings you use with LMStudio and make sure to use the same settings in silly tavern. 3. obscenely high temp, obscenely low top p k you name it, same fucking reply over twenty times in a row. Join us for game discussions, tips and tricks, and all things OSRS! OSRS is the official legacy A place to discuss the SillyTavern fork of TavernAI. BZAKZ /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will bankrupt app developers, hamper moderation, and exclude blind users from the site. Top P: Chooses the smallest set of words whose cumulative probability exceeds the threshold P, promoting diversity in general, however, many hate Top p as it cuts a lot of tokens out that Set Min P to 0. 11 votes, 52 comments. ) and the advanced formatting tab (context templete or instruction templete). 20 A place to discuss the SillyTavern fork of TavernAI. Let's say you have a Top P of 0. Common Links: The best place for fast help with SillyTavern issues is joining the discord! We have lots of moderators and community members active in the help sections. Sort by: Top 4% Rank by size . 80, and your top two tokens are: 81% 19% Top P would completely ignore the 2nd token, despite it being pretty reasonable. That was from a tip I read a bit ago. yet. However with the infermatic API we must have the Top P <1 and the Top K > 0. if they're too long, lower your response length and min length if it's too short, raise your response length and min length, you may have to go back and edit a few messages for it to get on track. Turn Mirostat Mode to 2, Tau to 5, and eta to 0. silly-tavern is safe, yes! what the other posts are talking about is some other form of API, but the one you are using is perfectly safe. # Top A. Use moderate values of Min-P/Top-P. 2 I think. 1. 5. Top posts of October 17, 2023. Once you are in Kiwi Browser login to poe. 05 with it. The future of SillyTavern and AI chatbots in general. I unlocked mine and set it to 4,218. Fixed transparency for zoomed avatars. cpp is broken **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Fixed macros replacement in the first message if there are alternate greetings. Advanced ones: Make sure your tokenizer is valid(on the server side, NOT in SillyTavern). (New reddit? Click 3 dots at end of this message) Privated to protest Reddit's upcoming API changes. Termux should be an option, then when you tap it you should see the SillyTavern folder and tap it as well. reReddit If responses are repetitive, make your rep. 3 mixtral context and instruction preset and set it to a specific temperature,top p top k sampling. I write in the default author's note "{ Write one response as {{char}} in roleplay format. top p, repetition penalty and such which are the same as ST. Text Generation WebUI: added DRY sampling controls. p. Ooba also turns of temperature/dyn temp if you have smoothing on, tabbyAPI doesn't. 5 or Claude Instant is selected and there is an open blank chat in front of you. Or check it out in the app stores SillyTavern is a fork of TavernAI 1. s. Use Dynamic Temperature for Mixtral/Mistral based finetunes, and use Min P instead of old samplers like Top K/P. 5 minimum and 3 maximum, doesn't really seem to matter too much) with min_p at 0. Then, Mirostat mode 2, Eta 8 and 0. SillyTavern is a Negative values promote repetition. Please keep all posts and comments related to SillyTavern, its features, or AI text generation in general. 26 users here now. It's likely you are using old samplers like top p/k instead of min p/dynamic temp/tail free or similar. If you're running it locally, I recommend Min P between 0. Fixed /del command deleting all messages on counter overflow. Try temperature last/first. Fortunately kalomaze invented dynamic temperature that is on ooba I believe and likely coming to koboldcpp soon, and is already cooking up a new improved sampler as well. 60, Rep. After continuous tests, I've found out that Top K at anything lower than 60-100 often ruins the model's performance with incoherence and odd phrases. 1 and Smoothing Factor at 0. A lower number is more consistent but less creative. it is similar to ray tracing: if you sample a single shadow ray, you will get a rough shadow, complaining that you can get better shadow by smoothing it in the stencil, but if you sample several shadow rays, and do that recursively, you will get proper smooth For example: Temperature: 5, Min P: 0. You can do typ_p of . TabbyAPI: added speculative ngram, **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. The older samplers perform very badly on mistral based models. r/snowflake Get the Reddit app Scan this QR code to download the app now. This is the home of the wedding photographer community on Reddit and the place for wedding photographers, second photographers, assistants, and those aspiring to be wedding Nous hermes 2 mixtral is extremely good with group chat if you use it with the noromaid 0. It sounds like you're using Open AI as the backend you connect SillyTavern to, and that's the problem, because the fun police at OAI check what gets sent back and forth to the models they run. Top P. SillyTavernAI join leave 32,266 readers. For non commercial use it's completely free. 4. Then select window. Apart from these small adjustments it gives me something really excellent. ai in silly tavern. At this point they can be thought of as completely independent programs. Min P Value of 0. I propose a simplified standard preset for Mixtral, similar to what I've recommended in the past, but with a reduced Min P. The cost with gpt3. SillyTavern is a **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. . Personally I think the summarise and smart context features of the Silly Tavern extras are better-suited to that, I just use Author's Notes for whatever the current reality of the scene is, or things I want the AI to be frequently reminded of. Hi guys! After playing for some times with HordeAI and Mancer, I want to get back to run some models on my hardware. 1 and repetition penalty at 1. My generation settings for both models were the same, base preset is Godlike, but I changed the following: 600 tokens response length, 4k context, 1. Don't use Top-K. "X is trying to Y", "P talks like a pirate", that sort of thing. Top-up defines how much sampling is done from previous messages. Using OpenRouter inference data, we did an analysis on the preferred parameters in various popular open-source models. 00-1. A place to discuss the SillyTavern fork of TavernAI. Anyway, maybe - before that - try turning the trimming off (a checkbox under context template settings), but that will result in leftovers from the unfinished sentences being displayed. Fixed sending empty bad_word_ids lists to **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Go for Roleplay preset and replace system prompt with this: Below is a set of instructions that describes three new directives. Unofficial SillyTavern Website: https://sillytavernai. Fixed WI editor breaking if the entry is not found in the WI file. Range. 36, and now SillyTavern 1. Also A place to discuss the SillyTavern fork of TavernAI. 80 I messed around with top P, CFG scale, temperature, rep pen, and phrase rep pen. If responses are repetitive, make your rep. so maybe you have some suggestions. Haven’t touched sillytavern in a good 3-4months, getting the urge to come back again. Okay, SillyTavern isn't the problem here. 05 - 0. Words with a probability lower than this threshold are not considered, meaning no weird or out of place words. 03 or lower. It will be titled "Poe API Settings" and at the top is Context Size as a slider. I have pretty much been using all these exact settings in SillyTavern for a while and get good responses. I hope this is the magic bullet, because typing (most) all of **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. 64, cfg scale 1. 0) and try other penalty samplers. If you have an idea of how much and how thick you Yeah, you can use Author's Note that way. Top 5% Rank by size . My current favorite preset is simply Top K = 64. 75 it would limit the tokens to choose up This subreddit is focused on SillyTavern and related topics. 1 min P and 1. 1 enough yet. Limits the token pool to however many tokens it takes for their probabilities to add up to P. Plus on top of that your samplers can change it from smart to dumb, or just incoherent. 08, rep pen freq 0. In some places, including ST, temps below 1 are considered low, and those above 1 as high. 37 Welcome to Destiny Reddit! This sub is for discussing Bungie's Destiny 2 and its predecessor, Destiny. 05-1. General. But I've also read elsewhere that the temperature for models is supposed to be from 0 to 1, and that 0. Slope: 0. 50, top k 89, typical P 0. It seems to work at Instead of launching the startup script directly from a Start Menu shortcut, define the shortcut to launch it indirectly through Windows Terminal (wt -w 0 -p "SillyTavern") . 5; Set the value to 0 to disable its effect. But I'm so confused on how to get it all up and running. 00 temp, 3. Please read the sidebar rules **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. It also works with Min-P very well, because Min-P is extremely good at filtering nonsensical low probability tokens, allowing very high temperatures. Reply reply Top K, Top P, Typical P, Top A - All those samplers affect the amount of tokens used at different stages of inferencing. **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with Get the Reddit app Scan this QR code to download the app now A place to discuss the SillyTavern fork of TavernAI. Top P, Typical P, Min P) are basically designed to trust the model when it is especially confident. I'm curious about y'alls thoughts, what do you think will happen? Anyways I'm eager to hear what you lads think :p The settings about halfway down the main model page go into all the variables to set. 3. 5. Next, you need a file explorer on your phone. I use FX File Explorer, and this guide will assume you do too. However, a lot of samplers (e. 7 would be considered on the high side. Backends. 2 or above (YMMV), low RepPen, Top P to the max, and Top K to the bottom. I believe qwen and miqu are among the top rated (by people, though also by benchmark for the most part). S. 8 which is under more active development, and has added many major **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. 2. 08 Min-P 1. 0 (to disable) - Turn Min P to a reasonable value (try 0. Tail Free Sampling: Similar to Top P, this setting is another I've connected SillyTavern to ooba and had a few interactions that worked well. Tail Free Sampling - No idea. Yes you need to generate a key. I would recc to keep it at or lower than 4,000. 0 - Min P: 0. 1, no lower than 0. I'd love to use it to role play (nsfw/no filters) with capability to create images. I always clean install them. 1 for me. You open it, then at the top right, press the three dots and select "Connect to storage". This leads to higher determinism in responses unnecessarily. I have an older laptop with gtx950m I use as a server, which hopefully can be used for SillyTavern. Learn more: https://sillytavernai Was certainly very ready to get filthy, so that's a plus. get reddit premium. The latest tag for GHCR containers now points to the latest release branch push. 07. 7. 0 and top p disabled but it's up to preference honestly. Set XTC Threshold to 0. Dynamic temperature from . 95 and min_P of . If you don't see **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. So turn off / neutralize all samplers, and temps above 1 will start to have an effect again. More posts you may like r **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. V1 (The thing labeled with a T, T for TavernAI, the thing SillyTavern was forked from, and the format it used) is old, and is missing a bunch of things that V2 adds, mainly alternate greetings (So the first message can be something you can swipe for **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Using them can exclude a lot of tokens even with high temps. Presence penalty is too low: set it at 0. g. 8. Searching for alternatives . com/how-to-install-sillytavern Install on Windows Video: I'm sharing a collection of presets & settings with the most popular instruct/context templates: Mistral, ChatML, Metharme, Alpaca, LLAMA If you want your character follow instructions more closely for the cost of some creativity then you may try Temp=0. That basically just relies on Min P by negating Top P and Top K. I also checked Include Names in Instruct Mode, because without that, despite the prompt, the LLM kept speaking for me. If DRY is available, set DRY Multiplier to 0. 05 rep pen, 915 rep pen range, Top P 0. 15 repetition. If The model's list of chosen tokens based on the given prompt is the meat, the Top_A is the scalpel and the Min_P is a large normal knife. My main question is in regards to the AI response configuration tab (Temperature, Top K, etc. Top A; 1. SillyTavern but then they start mentioning how its complicated and everything and considering silly tavern has features and options that aren't A place to discuss the SillyTavern fork of TavernAI. ). Or check it out in the app stores My top #1 right now is airoboros 1. The settings about halfway down the main model page go into all the variables to set. Welcome to Destiny Reddit! This sub is for discussing Bungie's Destiny 2 and its predecessor, Destiny. Before this, I had Min_P at 0. Top K. I thought that maybe using SillyTavern + Poe(ChatGpt) could help, as it has some magic functionalities like keeping jailbreak at the top of the context(or something like that), adding important instructions with every prompt, addon that automatically creates summaries of events, but it still doesn't seem to help. SillyTavern is a A place to discuss the SillyTavern fork of TavernAI. Once you've selected Termux, press "Use this Folder". a social mobile app for iOS, Android, PC, and Amazon devices. 8 multiplier. the number one place on Reddit to discuss Elementor the live page builder for WordPress. Top_k is 0. SillyTavernAI join leave 32,241 readers. Once selected look for the 3 dots on the top right of the Apollo was an award-winning free Reddit app for iOS with over 100K 5-star reviews, built with the community in mind, and with a focus on speed, customizability, and best in class iOS features. 9. Another caveat about Top K vs Min P is the model sizes. It is free but the moment you start using it on sillytavern, it will charge based on the prompt sent to the api and the text completed. Get the Reddit app Scan this QR code to download the app now. reReddit: Top posts of October 2023. Top K: 0 Top P: 1. Node 18 or later is now required to run SillyTavern. Top_p: 0. Or check it out in the app stores A place to discuss the SillyTavern fork of TavernAI. 2-. Your settings are pretty good regarding the sampler. Reddit . 32k context, it's fast, and it can RP with the best of them provided you actually put some time into the character card. I noticed a lot of these settings are shared with ooba. 812, tail free 0. All fun and games until you start realizing just how much you'll be paying for a model that has unlimited context size because it'll get to the point where your prompt might reach 500k+ tokens and then on top of that there will also be a character card + your character persona + main prompt + authors note + jailbreak + god knows what else and you'll Smoothing by itself from . Gemini Pro API is probably the best free model. Then from the new menu, choose 'External storage' and tap the hamburger on the top left again. Smoothing factor, top P of 1 top K of 0, etc. More posts you may like r/2007scape. 5 to 1 or 1. Here are the insights! Goliath-120b: Temperature suggests a moderate level of creativity, while frequency and presence penalties encourage diversity without excessive repetition. 02 imo) - Ensure temp_last is enabled if you are on ooba (this is the default for kobold) - Turn up temperature a bit if necessary, even 2. It defaults to "locked" and will be at the max of 2048. 73. Typical Sampling; 1. 0 but I have no clue what I want my top k Top p is supposed to select tokens that sum up to x probability. Pen. It wasn't your question at all, but in case anyone comes up with the problem I had of massive repetition loops - I think I found the solution in these settings - temp 1. Limits the token pool to the K most likely tokens. 11. On the noisy front tho, it might just be a matter of the right settings (after all mythomax also has this problem). 3 temp (adjust this if you want, sometimes I lower it), I leave Top P and K and that stuff on the default from the preset. I. Tail Free Sampling; 0. So, umm, I was wondering if anyone knows of a free interface or web page that has the same roleplay ability as Poe (Creative manner of writing, characters and nsfw allowed)I don't have much RAM space so I can't run KoboldAI :,)I also tried **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. In fact, it helps allow for more diverse choices in a way that Top P typically won't allow for. 15 repetition penalty and 1. Default is Min Temp 0, Max Temp 2. (I don't check notifications from reddit. Please read the sidebar rules and be sure to A place to discuss the SillyTavern fork of TavernAI. 0 can be stable with temp_last - As a last resort, turn up rep pen between 1. 9, 0. - Turn Top P to 1. For those of you using models that allow you to tinker with its settings; what are the values of top p and top k you usually aim for? My top p is usually 1. 1 pick from top Wow, what a week! Llama 2, koboldcpp 1. 75 instead of the default 0. Don't play with samplers that you have no clue what they do. sdqa cuokq duas ieazyc nmwonan aps tezthxa gsuf xtun vwfd