Logo

Community Validator Discussions

Discussions from the Solana Validator Community on operations, upcoming changes, and best practices.

Validator Discussion - May 25 2023

Validator Discussion - May 25 2023

by Solana Foundation

The Solana validator community discusses the software version 1.14.17 being adopted by the mainnet-beta cluster, changes in version 1.14.17, the upcoming solana validator workshop as well as the upcoming community led validator call on May 31st. -------------------------------------------- IMPORTANT LINKS 1.14.17 summary: https://forum.solana.com/t/version-1-14-17-release-summary/175 Accounts index: https://forum.solana.com/t/feature-accounts-index-on-disk-1-14-17/190 Compact vote state: https://forum.solana.com/t/feature-compact-vote-state-1-14-17/174 Educational workshop playlist: https://www.youtube.com/watch?v=86zySQ5vGW8&list=PLilwLeBwGuK6jKrmn7KOkxRxS9tvbRa5p Squads Protocol for validators: https://docs.squads.so/squads-v3-docs/navigating-your-squad/developers/validators VAMP: https://github.com/bji/solana-vamp -------------------------------------------- CHAT LOGS AND TRANSCRIPTS https://solanafoundation.notion.site/Community-Validator-Discussion-May-25-2023-b8d15d55fddc43a78e68bc7ba1b5f57d 00:00 Intro 00:38 1.14.17 adopted by mainnet-beta 01:29 1.14 features for validators 03:26 Improved startup times - save state 04:54 1.13 startup time bug 05:35 Compact Vote State Discussion 07:44 Reminder to report bugs 11:58 Testnet updates 13:35 Education workshop validator setup 14:34 Community Led Validator Call 15:26 Quick VAMP overview 16:20 Open Discussion DISCLAIMER The content herein is provided for educational, informational, and entertainment purposes only, and does not constitute an offer to sell or a solicitation of an offer to buy any securities, options, futures, or other derivatives related to securities in any jurisdiction, nor should not be relied upon as advice to buy, sell or hold any of the foregoing. This content is intended to be general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented without undertaking independent due diligence and consultation with a professional advisor. Solana Foundation Foundation and its agents, advisors, council members, officers and employees (the “Foundation Parties”) make no representation or warranties, expressed or implied, as to the accuracy of the information herein and expressly disclaims any and all liability that may be based on such information or any errors or omissions therein. The Foundation Parties shall have no liability whatsoever, under contract, tort, trust or otherwise, to any person arising from or related to the content or any use of the information contained herein by you or any of your representatives. All opinions expressed herein are the speakers’ own personal opinions and do not reflect the opinions of any entities.

Validator Discussion - May 11 2023

Validator Discussion - May 11 2023

by Solana Foundation

The validator community discusses the upcoming Mainnet-Beta rollout of software version 1.14.17, the new Solana Foundation head of staking, Ben Hawkins, the Smart Validator Toolkit (https://svt.one) and Marinade's directed stake product (https://docs.google.com/presentation/d/1pwCR8D45OypGGkmdtUWx8o3iYPJFp8stD8h8RPj1tXc/edit?usp=sharing) 00:00 Intro and Agena 00:43 Mainnet Beta Rollout 1.14 03:38 Testnet updates 04:16 Educational Workshop May 31st 05:30 Head of Staking Ben Hawkins 08:27 Smart Validator ToolKit Walkthrough 19:20 Marinade Directed Stake Presentation 29:00 Marinade Q+A ------------------------------ IMPORTANT LINKS Solana Validator Educational Workshops Playlist: https://www.youtube.com/watch?v=86zySQ5vGW8&list=PLilwLeBwGuK6jKrmn7KOkxRxS9tvbRa5p Smart Validator Toolkit: https://svt.one Marinade Directed Stake Presentation: https://docs.google.com/presentation/d/1pwCR8D45OypGGkmdtUWx8o3iYPJFp8stD8h8RPj1tXc/edit?usp=sharing Marindate Validator Survey: https://gmm1to3q6tq.typeform.com/to/TmS8f9Mc?typeform-source=www.google.com ----------------------------------- CHAT LOGS AND TRANSCRIPTS https://solanafoundation.notion.site/Community-Validator-Discussion-May-11-2023-Chat-Logs-ecdb9b8131a7495abcec50b3f3f184bd DISCLAIMER The content herein is provided for educational, informational, and entertainment purposes only, and does not constitute an offer to sell or a solicitation of an offer to buy any securities, options, futures, or other derivatives related to securities in any jurisdiction, nor should not be relied upon as advice to buy, sell or hold any of the foregoing. This content is intended to be general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented without undertaking independent due diligence and consultation with a professional advisor. Solana Foundation Foundation and its agents, advisors, council members, officers and employees (the “Foundation Parties”) make no representation or warranties, expressed or implied, as to the accuracy of the information herein and expressly disclaims any and all liability that may be based on such information or any errors or omissions therein. The Foundation Parties shall have no liability whatsoever, under contract, tort, trust or otherwise, to any person arising from or related to the content or any use of the information contained herein by you or any of your representatives. All opinions expressed herein are the speakers’ own personal opinions and do not reflect the opinions of any entities.

Validator Discussion - April 27 2023

Validator Discussion - April 27 2023

by Solana Foundation

The Solana validator community meets to discuss recent updates to the network, the most recent validator educational workshop (https://www.youtube.com/playlist?list=PLilwLeBwGuK6jKrmn7KOkxRxS9tvbRa5p) and a demo from Scale3 of their validator monitoring product at https://www.scale3labs.com/ Chat logs Tim Garcia: https://www.youtube.com/playlist?list=PLilwLeBwGuK6jKrmn7KOkxRxS9tvbRa5p Ola muse: Hi Nathan Nathan Smith: Hey everyone! Mihhail Sidorin: it is tricky to find the pricing at your site Mihhail Sidorin: would be awesome to "compact it into one install script" as NetData doing :) Jay Thakrar: Hi Mihhail - thanks for your question. We are currently offering Scale3 for free for 1 validator or node for 1 protocol. If you are running more than 1 node or validator, we charge $50 / node or validator / month (limited time offer). Feel free to sign up and let us know what you think! :) Zantetsu: Is that script run on the validator or on another device or does it matter? Mihhail Sidorin: My "Billing" shows 99 as limited time offer Karthik Kalyanaraman: Re: one install script. Good idea. We initially wanted to compact it into one install script. But, wanted to keep it transparent in terms of what a node operator is running on your node. The script is run on the validator host. Its just a grafana agent configuration. Jay Thakrar: Ah - thanks for flagging, that was our original pricing, however, we are running a limited time offer, we will make that change. For now, you will not be charged, and we will update that on the My Billing page - thanks again for flagging! Mihhail Sidorin: you might want to "transparently" indicate Firewall setup Karthik Kalyanaraman: Agreed. that's a good feedback. Zantetsu: Or installing a root kit Mihhail Sidorin: :D Mihhail Sidorin: I made my process of installing monitoring automated as fast as possible, that is one of the first skills to learn Mihhail Sidorin: right after rootkits Mihhail Sidorin: :DDD Mihhail Sidorin: hint: you can follow solana announcements to your discord server Ola muse: Agree Mihhail, but still very Noisy.. with everything else on discord. with our platform we provide the best signal over noise etc Blake Bartenbach: Operators really shouldn't be detached from the Solana tech discord. Especially if there is an outage or something that requires collaboration among operators Zantetsu: One of my pet peeves is people coming to Discord to ask for confirmation of something that ChatGPT said, and usually it's something that appears to make sense but is wrong. I'm very skeptical about using LLM in this way ... Zantetsu: As long as it's high quality, that's great, but it has to be spot on. Ola muse: Agree Zantetsu Karthik Kalyanaraman: yeah, we only trained it on the markdown files so the accuracy is high. nothing crazy like training on code etc. which some of the other tools did where accuracy is not that great. Mihhail Sidorin: My node version is incorrectly detected in scale3 dash Blake Bartenbach: Voting: Jailed Zantetsu: Apparently it's not a voting validator, so I guess that's one of the ways it indicates that Blake Bartenbach: I think that might help a lot of people that wouldn't be engaged enough to attend this meeting Karthik Kalyanaraman: this is a great feedback Michael Hubbard: I think you're thinking of Squads, Zan DISCLAIMER The content herein is provided for educational, informational, and entertainment purposes only, and does not constitute an offer to sell or a solicitation of an offer to buy any securities, options, futures, or other derivatives related to securities in any jurisdiction, nor should not be relied upon as advice to buy, sell or hold any of the foregoing. This content is intended to be general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented without undertaking independent due diligence and consultation with a professional advisor. Solana Foundation Foundation and its agents, advisors, council members, officers and employees (the “Foundation Parties”) make no representation or warranties, expressed or implied, as to the accuracy of the information herein and expressly disclaims any and all liability that may be based on such information or any errors or omissions therein. The Foundation Parties shall have no liability whatsoever, under contract, tort, trust or otherwise, to any person arising from or related to the content or any use of the information contained herein by you or any of your representatives. All opinions expressed herein are the speakers’ own personal opinions and do not reflect the opinions of any entities.

Validator Discussion - April 13 2023

Validator Discussion - April 13 2023

by Solana Foundation

The validator community discusses validator client updates to the network, an upcoming educational workshop on important log messages, and the launch of the Solana saga mobile phone: https://solanamobile.com/hardware Chat history: 00:01:18.761,00:01:21.761 melea crypto: We upgrade to v1.14.17 😎 00:02:00.840,00:02:03.840 Al3c5 (p2pstaking.org/): will update to 1.13.7 tonight 00:02:17.686,00:02:20.686 melea crypto: We upgrade one RPC to v1.13.7 everything fine 00:08:43.096,00:08:46.096 Brian Long: Youtube 00:08:44.168,00:08:47.168 Ionut Scirlet: https://www.youtube.com/watch?v=HpHLWRfTlm8 00:12:06.728,00:12:09.728 Tim Garcia: For curious https://www.validators.app/log-deep-dives/slot-72677728?locale=en&network=mainnet 00:15:00.272,00:15:03.272 Tim Garcia: discord bot discussion happening here #proj-validator-gated-roles 00:16:04.287,00:16:07.287 Blake Bartenbach: https://solana.com/breakpoint/travel 00:18:49.039,00:18:52.039 chris / chainflow: agreed 00:19:30.962,00:19:33.962 Overclock Validator: Not sure yet... limited time to gradschool 00:20:35.834,00:20:38.834 Blake Bartenbach: That would be super cool! DISCLAIMER The content herein is provided for educational, informational, and entertainment purposes only, and does not constitute an offer to sell or a solicitation of an offer to buy any securities, options, futures, or other derivatives related to securities in any jurisdiction, nor should not be relied upon as advice to buy, sell or hold any of the foregoing. This content is intended to be general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented without undertaking independent due diligence and consultation with a professional advisor. Solana Foundation Foundation and its agents, advisors, council members, officers and employees (the “Foundation Parties”) make no representation or warranties, expressed or implied, as to the accuracy of the information herein and expressly disclaims any and all liability that may be based on such information or any errors or omissions therein. The Foundation Parties shall have no liability whatsoever, under contract, tort, trust or otherwise, to any person arising from or related to the content or any use of the information contained herein by you or any of your representatives. All opinions expressed herein are the speakers’ own personal opinions and do not reflect the opinions of any entities.

Validator Discussion - March 30 2023

Validator Discussion - March 30 2023

by Solana Foundation

The Solana validator community discusses the Mainnet-Beta rollout plan for 1.14, an update to validator gated linked roles in discord, and the pros and conts of the jito validator client versus the Solana labs client. Chat logs: Naor Shukrun: Can we do longer 1.14 onboarding. Something like 10 - 25 - 40/45 and 100? Falco Langeveld: +1 Naor Sol Blaze: I think it might be nice to have testnet running in that weird dual version state where neither version gets a supermajority for these kinds of rollouts just to make sure nothing destabilizes when that situation happens. Sam Legends: Good call out. I didn't realize that Sam Legends: that Zantetsu: I recommend 50/50 for a while Zantetsu: that seems like the most strenuous test Naor Shukrun: Thanks 🙏 Tim Garcia: https://hackmd.io/@jnwng/validator-gated-discord-roles Sol Blaze: For the channel, I assume some of the other roles like Solana Labs, Foundation, contributors, etc. will also be able to access this channel? Or will it be strictly node operators Blake Bartenbach: I would prefer the design you just described without a third party website Sol Blaze: The problem with removing the phone number verification on a case-by-case basis is that it's the built-in Discord security setting and their security options are not super granular so it can't really be applied per user natively in Discord (you would have to disable it server-wide and offload it to another bot or something) Blake Bartenbach: Can't stop you from doxxing yourself Zantetsu: Regarding the phone number verification, I wonder if we even need it at all any more Bryon M: I think it should be view only for anyone. Zantetsu: It supposedly helped back when there were actual scammers/spammers filling up the Discord Sam Legends: I only run 8 validators, so not a big deal 🤷 Zantetsu: But there aren't many any more, and it never seemed to stop them anyway Bryon M: It's like 0.10$ for a phone number Blake Bartenbach: I mean really a phone number doesn't even identify you if you use a Google voice number. We can't stop people from doxxing themselves. I think if people want complete anonymity then they need to take responsibility for that themselves. Azul Dev: I made a discord validator controller a few weeks ago I'm updating it to a UI based validator controller https://github.com/redazul/vali/blob/main/vali-server.js Can be called by discord / web / any device with an internet pulse Azul Dev: cool cool Azul Dev: Multiple client source code is good and competitive Blake Bartenbach: +1 for plugin architecture. People should be able to run whatever they want. Bryon M: Trust or not, I think people should run their own relayer. Even though it requires mid level hardware Sol Blaze: Not sure if Laine is able to make it to the call today but I feel like I remember something about Laine planning to run their own relayer so maybe you could talk to them about that process Zantetsu: It's too infrequent Blake Bartenbach: Agree, just would like to see more of it Tim Garcia: #core-community-call Tim Garcia: https://www.youtube.com/watch?v=XZhy9VFGKZc Zantetsu: Thanks! Bryon M: Thanks DISCLAIMER The content herein is provided for educational, informational, and entertainment purposes only, and does not constitute an offer to sell or a solicitation of an offer to buy any securities, options, futures, or other derivatives related to securities in any jurisdiction, nor should not be relied upon as advice to buy, sell or hold any of the foregoing. This content is intended to be general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented without undertaking independent due diligence and consultation with a professional advisor. Solana Foundation Foundation and its agents, advisors, council members, officers and employees (the “Foundation Parties”) make no representation or warranties, expressed or implied, as to the accuracy of the information herein and expressly disclaims any and all liability that may be based on such information or any errors or omissions therein. The Foundation Parties shall have no liability whatsoever, under contract, tort, trust or otherwise, to any person arising from or related to the content or any use of the information contained herein by you or any of your representatives. All opinions expressed herein are the speakers’ own personal opinions and do not reflect the opinions of any entities.

Validator Discussion - March 16 2023

Validator Discussion - March 16 2023

by Solana Foundation

The Solana validator community celebrates the third birthday of the Solana blockchain! Anatoly joins the call to review new testing improvements. Lucas from Jito presents their findings on spam transactions on the blockchain. 00:00 Intro and Agenda 00:31 Happy Birthday Solana! 01:00 Testnet restart on 1.13.6 01:51 Anatoly talks testing 07:18 Jito presents spam findings 32:00 Open discussion Chat logs: Tim Garcia: Blog post on testing https://solana.com/news/plans-to-improve-the-network-upgrades melea crypto: Share link Tim Garcia: mev spam investigation: https://medium.com/@Jito-Foundation/solving-the-mev-problem-on-solana-a-guide-for-stakers-7768308e93bc melea crypto: Ty Brian Smith: Presentation link: https://drive.google.com/file/d/1P9rA4NpC8ENBwn88LeV4VtDFc1Kxd9AY/view?usp=share_link Overclock Validator: Why is spamming still a helpful strategy? melea crypto: We are going to jito very soon ! Dan Albert: where can a validator see what other nodes are running jito-solana? it would be helpful for adoption for public nodes to see which of their peers are already running jito, to gain comfort. Brian Long: validators.app shows Jito validators! Blake Bartenbach: Nice! Brian Smith: https://jito.retool.com/embedded/public/3557dd68-f772-4f4f-8a7b-f479941dba02 Brian Smith: Validators.app, manystake, the above link and other sites hopefully soon will all flag Jito for awareness Brian Long: See https://www.validators.app/validators?locale=en&network=mainnet&order=stake & look for the "Jito" toggle Blake Bartenbach: Yep, I was going to say, I thought ManyStake also did https://www.manystake.com/validator-view?client=jito Nick Garfield: Looking forward to jito-client! Overclock Validator: Bullish on fee per cu base fee Cyrial Kamda: ^ Overclock Validator: Sry gotta shill Blake Bartenbach: Sorry, it's not always clear - who is Lucas B on Discord? Ben Hawkins: Yeah economic incentives to make more compute efficient txns would make a lot of sense. Tim Garcia: buffalu#8451 Blake Bartenbach: Oh that's buffalu! Okay, thank you! Brian Long: Stats from Block Logic in the last hour: 212998 dropped_txs 73750 dropped_txs_WouldExceedBlockMaxLimit 139248 dropped_txs_WouldExceedAccountMaxLimit Ben Hawkins: I've found that fee priority doesn't work reliably. e.g. higher fee doesn''t always beat out lower fee. Sam Legends: Is there any public charts that show the % of dropped transactions? Brian Long: Sam, no. That data exists only on the validators. Sam Legends: Thanks Brian Ben Hawkins: Further more, each validator view of dropped txns is different Dan Albert: Anybody want to take a crack at updating the `solana validators` CLI to reflect solana vs jito-solana usage in the version readout? Brian Smith: Discord link: https://discord.gg/jito melea crypto: Thanks, nice presentation Emilio Oberg: fix mic Max Sherwood: Yeah Im here but outdoors haha Blake Bartenbach: Dan - would be nice if the RPC service could return that information. getVersion doesn't differentiate currently. Blake Bartenbach: Not sure if that's the source of making that happen Dan Albert: yeah, makes sense. PRs always open. not sure if getVersion statically points to the labs repo or what. haven't looked. Dan Albert: or could pull from whatever build sha Chris R: Initial focus is on follow-ups to post-mortem, will also add new topics as people propose them over time. Pull meaningful conversations out of Discord and provide some focus to help make them actionable. Dan Albert: https://twitter.com/DanPaul000/status/1635763828385529857 DISCLAIMER The content herein is provided for educational, informational, and entertainment purposes only, and does not constitute an offer to sell or a solicitation of an offer to buy any securities, options, futures, or other derivatives related to securities in any jurisdiction, nor should not be relied upon as advice to buy, sell or hold any of the foregoing. This content is intended to be general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented without undertaking independent due diligence and consultation with a professional advisor. Solana Foundation Foundation and its agents, advisors, council members, officers and employees (the “Foundation Parties”) make no representation or warranties, expressed or implied, as to the accuracy of the information herein and expressly disclaims any and all liability that may be based on such information or any errors or omissions therein. The Foundation Parties shall have no liability whatsoever, under contract, tort, trust or otherwise, to any person arising from or related to the content or any use of the information contained herein by you or any of your representatives. All opinions expressed herein are the speakers’ own personal opinions and do not reflect the opinions of any entities.

Validator Discussion - March 2 2023

Validator Discussion - March 2 2023

by Solana Foundation

The Solana validator community discusses a recent validator led network outage postmortem. Next, Solana Labs engineers answer questions about the root cause analysis of the February 25th outage. Lastly, the group discusses new release process plans for mainnet. Table of contents 00:00 Introduction and agenda 01:00 Community led postmortem summary 08:13 Update of ongoing root cause analysis 12:00 New plans for testing/releases CHAT LOGS ---------------- Tim Garcia: https://hackmd.io/@KFEZk8oMTz6vBlwADz0M4A/SJ4sCr9Ai Tim Garcia: Notes from the community lead post mortem Rustam Aldaganov: Предлагаю посмотреть Jam-файл: https://jamboard.google.com/d/1mYuPdNz9tYA4XKKUkWkwuLNbDs8mGGT6pMvHT7hbSnY/edit?usp=meet_whiteboard. Zantetsu: Rustam not sure what that is, it denies me access to view it Zantetsu: Hm maybe a Russian translation fo the doc that Max posted, just guessing Tim Garcia: Official report from Solana.com: https://solana.com/news/02-25-23-solana-mainnet-beta-outage-report Tim Garcia: Ongoing discussion in #mb-outage-20230225 Tim Garcia: https://solana.com/news/plans-to-improve-the-network-upgrades Kollan House: +1 Naor Shukrun: why we went with 1.14.6 as recomended before evenallowing 5% to upgrade and than 20 etc Naor Shukrun: 1.14.16* Thenoblest: nice plan Overclock Validator: Yeah maybe more perfectionism is required... we were seeing regular 1 min fork/confirmation stalls on mb Overclock Validator: Maybe some of the forking is caused by block/account cu limits not being tuned enough MCF MCF: i came late so sry if this is redundant - but i assume you fed the "fat" block into testnet - and it didn't crash ? Overclock Validator: Idk if the longer confirmation stalls were being looked into before Azul Dev: lol @ solar flare Blake Bartenbach: a SOLar flare Naor Shukrun: so I missed it, sorry! MCF MCF: those changes are gated tho right Brian Long: And 1-week advance notice too. Tim Garcia: Yes, the plan is to create a fat block in testnet and crash it. Michael Hubbard: @Steve I haven't seen the talk about creating stake accounts on discord? Michael Hubbard: I thought the goal these days was to primarily keep these discussions public Max Sherwood: Lido told us to upgrade toward the end of the week Thenoblest: What if send a "fat" block to version 1.15 in the testnet, I wonder what effect it will have. Zantetsu: The fat block happened at a "random" time though, there is no preparing for that Steve Czabaniuk: That happened to be a conversation that happened in person, but generally yes, we try to keep things in public domain Blake Bartenbach: I believe the politically correct term is "thicc block" Overclock Validator: Max what validator do yall run? MCF MCF: @Blake lol Max Sherwood: We run H2O Nodes Tim Garcia: Identity transition demo: https://pumpkins-pool.gitbook.io/pumpkins-pool/ Overclock Validator: Oh nice. Glad to see you running a validator -- didn't know you were Max Sherwood: Yeah I work full time at Ultimate.app and run the H2O Nodes validator together with a friend who is the actual IT/devops guy Max Sherwood: We were onboarded to Lido's node operator set last year so we get stake from them Max Sherwood: but it's a public validator Kollan House: Thanks everyone DISCLAIMER The content herein is provided for educational, informational, and entertainment purposes only, and does not constitute an offer to sell or a solicitation of an offer to buy any securities, options, futures, or other derivatives related to securities in any jurisdiction, nor should not be relied upon as advice to buy, sell or hold any of the foregoing. This content is intended to be general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented without undertaking independent due diligence and consultation with a professional advisor. Solana Foundation Foundation and its agents, advisors, council members, officers and employees (the “Foundation Parties”) make no representation or warranties, expressed or implied, as to the accuracy of the information herein and expressly disclaims any and all liability that may be based on such information or any errors or omissions therein. The Foundation Parties shall have no liability whatsoever, under contract, tort, trust or otherwise, to any person arising from or related to the content or any use of the information contained herein by you or any of your representatives. All opinions expressed herein are the speakers’ own personal opinions and do not reflect the opinions of any entities.

Validator Discussion - February 16 2023

Validator Discussion - February 16 2023

by Solana Foundation

The Solana validator community discusses validator updates for the Testnet and Mainnet-Beta cluster. There is an issue with high disk IO during validator startup that is being debugged on Solana Tech discord channel debug-disk-io-catchup-issue. The issue is not a blocker for the 1.14.x rollout on Mainnet-Beta. Next, Richard Patel from Jump gives updates on the Firedancer client (an alternative validator client being built by Jump). Video Contents: 0:00 Introduction and meeting agenda 0:46 Testnet and Mainnet-Beta validator updates 2:17 High IO issue on validator startup 5:37 Firedancer updates Chat Logs: 00:03:17.176,00:03:20.176 Zantetsu: Doesn't the disabled disk index cause more memory usage? 00:03:19.050,00:03:22.050 Nick Garfield: Does the high disk IO usage extend beyond startup? 00:03:20.528,00:03:23.528 Zantetsu: In my experience it does 00:03:39.205,00:03:42.205 Zantetsu: Might put those who are using memory for accounts to go over the dge 00:05:19.872,00:05:22.872 Nick Garfield: 👍 00:05:27.181,00:05:30.181 Zantetsu: Great info thanks 00:07:09.184,00:07:12.184 Tim Garcia: https://twitter.com/jump_firedancer/status/1613582309629857815?s=20 00:07:25.852,00:07:28.852 Zantetsu: Do you develop/test on the same operating system as recommended by Solana Labs for their validator (Ubuntu 20.04 I believe)? 00:07:43.926,00:07:46.926 Zantetsu: Just wondering if there will be different OS requirements/recommendations with your node software 00:09:01.538,00:09:04.538 MCF MCF: is it possible to do benchmarking against hardware at this time? 00:09:12.311,00:09:15.311 Steve Czabaniuk: From their GH, they mention testing with "a stock GCP RHEL8.5 image": https://github.com/firedancer-io/firedancer#host-setup 00:10:30.810,00:10:33.810 MCF MCF: firedancer 00:10:37.705,00:10:40.705 MCF MCF: performance benching 00:11:06.155,00:11:09.155 Cronchur The Dominator: Is there any branch where I can spin a frankendancer up on mainnet/testnet with ease? 00:11:46.935,00:11:49.935 Cronchur The Dominator: Right, iirc that one worked for solana-test-validator but not solana-validator 00:19:45.918,00:19:48.918 Cronchur The Dominator: Have we ever considered making QUIC window size proportional to latency? To account for the fact that throughput is already inversely proportional to window size? 00:20:04.397,00:20:07.397 Tim Garcia: https://github.com/firedancer-io/firedancer/discussions 00:20:19.173,00:20:22.173 Martin van Diggelen: Amazing work thank you for the detailed feedback

Validator Discussion - February 2 2023

Validator Discussion - February 2 2023

by Solana Foundation

The Solana validator community discusses a tutorial from /dev/null | Pumpkin's Pool#8888 on validator identity transitions to a hot backup: https://pumpkins-pool.gitbook.io/pumpkins-pool/. Next, Solana labs engineers discuss a validator panic on 1.14.x clients that occurred on February 1st. Chat logs: 00:00:01.217,00:00:04.217 Dmitry Bykov: Hello 00:01:48.149,00:01:51.149 Zantetsu: Put the cat on screen 00:01:51.593,00:01:54.593 Zantetsu: Where is the cat 00:04:52.753,00:04:55.753 Michael Hubbard: yes it is 00:05:14.952,00:05:17.952 Michael Hubbard: there was never any proof that it caused issues other than the correlation of loss of vote credits with the use of this script 00:06:37.239,00:06:40.239 Michael Hubbard: I don't use this method 00:07:49.174,00:07:52.174 Michael Hubbard: mvines has clarified that gossip updates pretty quickly, I always suspected that it was a gossip issue. GH issue for reference: https://github.com/solana-labs/solana/issues/24527 00:10:19.205,00:10:22.205 Michael Hubbard: the transition itself works great, very smooth, zero downtime, I'm just spooked by my issues in the past, but I hope they don't reproduce, so if enough others use this successfully I might try it again too :) 00:14:11.090,00:14:14.090 Zantetsu: Michael did you notice anything like what Blake mentioned where if the validator is not "healthy" then bad stuff happens when you try to switch identities? 00:14:21.524,00:14:24.524 Zantetsu: Where I suppose "bad stuff" is that the validator ignores the set identity maybe? 00:15:31.529,00:15:34.529 Michael Hubbard: nope 00:15:53.728,00:15:56.728 Michael Hubbard: as long as you somehow kill/stop the primary and run `solana-validator set-identity` on the secondary it has always worked for me 00:17:19.154,00:17:22.154 Blake Bartenbach: Yes, Zan. I think that is exactly the problem I have had. If the validator ignores the set-identity command, I think it needs to be killed. 00:17:49.483,00:17:52.483 Michael Hubbard: if the validator has crashed and is restarting then admin.rpc might not accept the set-identity command, perhaps that is the issue Blake? 00:17:59.181,00:18:02.181 Michael Vines: ya, thanks Blake! 00:18:03.219,00:18:06.219 Sol Blaze: Thanks for creating these docs, Blake! 00:18:38.639,00:18:41.639 Anish Nath: btw my handle is chatGPT in Solana discord and coming from rpcpool :) Brian/Linus Team 00:21:09.495,00:21:12.495 Tim Garcia: https://github.com/solana-labs/solana/issues/30060 00:21:11.589,00:21:14.589 Sol Blaze: Too much bad press surrounding early upgrading to v1.14, at this point we should just call it v1.15 haha 00:21:49.611,00:21:52.611 Tim Garcia: Bug description here: https://github.com/solana-labs/solana/issues/30060 00:22:12.931,00:22:15.931 Sol Blaze: I think it definitely shows that the incremental rollout strategy for Solana updates actually works in stopping these bugs 00:25:30.813,00:25:33.813 Tim Garcia: In discord #releng 00:30:37.453,00:30:40.453 Sol Blaze: There's also some stuff the Solana Staking Alliance is working on in terms of load testing on testnet/mainnet (nothing confirmed yet) so we could repurpose some stuff for testnet for continuous load in order to catch more bugs before new versions start getting incrementally rolled out on mainnet 00:31:16.768,00:31:19.768 Tim Garcia: kirill_l#4694 00:33:08.142,00:33:11.142 Sol Blaze: I am all for larger delegations from Delegation Program to those who do early upgrades. I'm planning to add a sort of "stake boost" on BlazeStake for extra stake to those running newer versions going forward, although that probably won't make as much of an impact, would love if other automated delegation systems joined in as well! 00:33:39.845,00:33:42.845 GNTHR: Will this be put on the youtube channel? 00:33:43.235,00:33:46.235 Sol Blaze: Yes 00:33:54.016,00:33:57.016 Sol Blaze: https://www.youtube.com/playlist?list=PLilwLeBwGuK78yjGBZwYhTf7rao0t13Zw 00:33:57.735,00:34:00.735 GNTHR: Good, thank you 00:38:17.639,00:38:20.639 Zantetsu: Yes thanks Solana devs, much appreciated! 00:38:29.265,00:38:32.265 GNTHR: Thank you

Validator Discussion January 19 2023

Validator Discussion January 19 2023

by Solana Foundation

The Solana validator community discusses a recently identified consensus but that was fixed in version 1.14.12, the upcoming core dev sync on January 20th, and validator client updates. We also celebrate the 400th mainnet-beta Solana epoch! Chat logs: 00:07:51.703,00:07:54.703 Steve Czabaniuk: Allesandro - can you give us the V2 teaser? 00:11:55.367,00:11:58.367 Code Monkey: Tim, have you thought of having these type of meetings geared towards RPC operators as well? There seems to be a big gap from the core team supporting the validator operators over the RPC operators. As someone that runs both, I would love to see some of the core team become a lot more involved on the RPC side. 00:15:11.052,00:15:14.052 Nick Garfield: For the security workshop, the date on the slide was Jan 20 (tomorrow). I assume this was a typo and Jan 25 was intended? 00:15:50.582,00:15:53.582 Tim Garcia: Yes, sorry typo. 25th 00:17:30.160,00:17:33.160 Emilio Oberg: party when 420 :d 00:17:40.917,00:17:43.917 Michael Vines: hi

Validator Community Discussion - January 5 2023

Validator Community Discussion - January 5 2023

by Solana Foundation

Lucas from https://www.jito.wtf/ joins the validator community discussion to give a background on the Jito MEV client. We discuss setup differences between the jito-solana client and the solana labs validator client.

Validator Community Discussion - December 22 2022

Validator Community Discussion - December 22 2022

by Solana Foundation

The validator community discussion was held on December 22nd 2022. The call includes validator software updates, a discussion of https://github.com/solana-labs/solana/issues/29346 (a proposal to change the vote program to only allow commission changes in the first half of an epoch), and a presentation from the marinade team about commission cheating as well as their new validator dashboard.

Validator Discussion - 17 March 2022

Validator Discussion - 17 March 2022

by Solana Foundation

DISCLAIMER The information on this podcast is provided for educational, informational, and entertainment purposes only, without any express or implied warranty of any kind, including warranties of accuracy, completeness, or fitness for any particular purpose. The information contained in or provided from or through this podcast is not intended to be and does not constitute financial advice, investment advice, trading advice, or any other advice. The information on this podcast is general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented on this podcast without undertaking independent due diligence and consultation with a professional broker or financial advisor.

Validator Discussion - 23 December 2021

Validator Discussion - 23 December 2021

by Solana Foundation

DISCLAIMER The information on this podcast is provided for educational, informational, and entertainment purposes only, without any express or implied warranty of any kind, including warranties of accuracy, completeness, or fitness for any particular purpose. The information contained in or provided from or through this podcast is not intended to be and does not constitute financial advice, investment advice, trading advice, or any other advice. The information on this podcast is general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented on this podcast without undertaking independent due diligence and consultation with a professional broker or financial advisor.

Validator Discussion - 6 January 2022

Validator Discussion - 6 January 2022

by Solana Foundation

DISCLAIMER The information on this podcast is provided for educational, informational, and entertainment purposes only, without any express or implied warranty of any kind, including warranties of accuracy, completeness, or fitness for any particular purpose. The information contained in or provided from or through this podcast is not intended to be and does not constitute financial advice, investment advice, trading advice, or any other advice. The information on this podcast is general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented on this podcast without undertaking independent due diligence and consultation with a professional broker or financial advisor.

Validator Discussion - 20 January 2022

Validator Discussion - 20 January 2022

by Solana Foundation

DISCLAIMER The information on this podcast is provided for educational, informational, and entertainment purposes only, without any express or implied warranty of any kind, including warranties of accuracy, completeness, or fitness for any particular purpose. The information contained in or provided from or through this podcast is not intended to be and does not constitute financial advice, investment advice, trading advice, or any other advice. The information on this podcast is general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented on this podcast without undertaking independent due diligence and consultation with a professional broker or financial advisor.

Validator Discussion - 3 February 2022

Validator Discussion - 3 February 2022

by Solana Foundation

DISCLAIMER The information on this podcast is provided for educational, informational, and entertainment purposes only, without any express or implied warranty of any kind, including warranties of accuracy, completeness, or fitness for any particular purpose. The information contained in or provided from or through this podcast is not intended to be and does not constitute financial advice, investment advice, trading advice, or any other advice. The information on this podcast is general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented on this podcast without undertaking independent due diligence and consultation with a professional broker or financial advisor.

Validator Discussion - 18 February 2022

Validator Discussion - 18 February 2022

by Solana Foundation

DISCLAIMER The information on this podcast is provided for educational, informational, and entertainment purposes only, without any express or implied warranty of any kind, including warranties of accuracy, completeness, or fitness for any particular purpose. The information contained in or provided from or through this podcast is not intended to be and does not constitute financial advice, investment advice, trading advice, or any other advice. The information on this podcast is general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented on this podcast without undertaking independent due diligence and consultation with a professional broker or financial advisor.

Validator Discussion - 3 March 2022

Validator Discussion - 3 March 2022

by Solana Foundation

DISCLAIMER The information on this podcast is provided for educational, informational, and entertainment purposes only, without any express or implied warranty of any kind, including warranties of accuracy, completeness, or fitness for any particular purpose. The information contained in or provided from or through this podcast is not intended to be and does not constitute financial advice, investment advice, trading advice, or any other advice. The information on this podcast is general in nature and is not specific to you, the user or anyone else. You should not make any decision, financial, investment, trading or otherwise, based on any of the information presented on this podcast without undertaking independent due diligence and consultation with a professional broker or financial advisor.