GOH 04 - Private Data source Connect

# [[GOH 04 - Private Data source Connect]] [in internal-docs]() <iframe width="560" height="315" src="https://www.youtube.com/embed/9oPe1IICE80" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe> Related:: "[[Stephanie Hingtgen]], [[Georges Chaudy]], [[Grafana Cloud Private Data Connect]]" ## Talking points - Introductions: who are you, where are you based, and what do you do at Grafana Labs? - Private Data Connect is in public preview and is available to paid Grafana Cloud plans. It will later be available for free plans. - One of the first big monitoring problems: security - How do you monitor an application that resides within a secure network, like a VPC or just a corporate network with a firewall? - Not publicly accessible over the internet - Workarounds - add IP addresses that Grafana Cloud uses to an allowlist, but we typically don't use [[Elastic IP address]]es, so this needs to be an IP range. - Self-host Grafana and your own socks5 server (all open source) - https://grafana.com/docs/grafana/next/setup-grafana/configure-grafana/proxy/ - Instead: Private Data Connect - How does it work? - PDC Agent creates a tunnel between your network and Grafana Cloud - Installation and configuration (demo) - Some FAQs - Why not a VPN? - Why not use existing cloud provider services like [[AWS PrivateLink]] or [[GCP Private Service Connect]]? - What are the differences between PDC and using a self-hosted socks5 server with TLS? - How does it scale? - Can you have multiple replicas of it? - How secure is it? - Limitations - Only one private network for now - Paid plans only (Grafana Cloud Pro, Advanced, Enterprise) in the future. - Not all data sources are supported [00:00:00](https://www.youtube.com/watch?v=9oPe1IICE80&t=0s) Introductions to Stephanie and Georges [00:01:51](https://www.youtube.com/watch?v=9oPe1IICE80&t=111s) What is Private Datasource Connect and why do we need it? [00:06:10](https://www.youtube.com/watch?v=9oPe1IICE80&t=370s) How does PDC work? [00:10:28](https://www.youtube.com/watch?v=9oPe1IICE80&t=628s) Demo: How to install Private Data source Connect on Grafana Cloud [00:13:35](https://www.youtube.com/watch?v=9oPe1IICE80&t=815s) What's the difference between PDC and a VPN? [00:18:49](https://www.youtube.com/watch?v=9oPe1IICE80&t=1129s) What's the socks5 protocol? [00:20:00](https://www.youtube.com/watch?v=9oPe1IICE80&t=1200s) Installing Private Data source Agent in Kubernetes and as a binary [00:22:16](https://www.youtube.com/watch?v=9oPe1IICE80&t=1336s) Is PDC secure? How do you restrict it to certain ports? [00:30:49](https://www.youtube.com/watch?v=9oPe1IICE80&t=1849s) What types of data sources can be used with PDC? [00:32:04](https://www.youtube.com/watch?v=9oPe1IICE80&t=1924s) Security and penetration testing done on PDC [00:33:28](https://www.youtube.com/watch?v=9oPe1IICE80&t=2008s) Testing PDC for performance and scalability [00:38:21](https://www.youtube.com/watch?v=9oPe1IICE80&t=2301s) Limitations on data sources that you can use PDC with [00:43:43](https://www.youtube.com/watch?v=9oPe1IICE80&t=2623s) How can we use PDC now? [00:48:12](https://www.youtube.com/watch?v=9oPe1IICE80&t=2892s) Challenges faced while developing PDC [00:53:44](https://www.youtube.com/watch?v=9oPe1IICE80&t=3224s) Extra options for infrastructure when using PDC [00:57:00](https://www.youtube.com/watch?v=9oPe1IICE80&t=3420s) Future plans for PDC ## Checklist - [x] Contact the guest and tell them about Office Hours. > At Grafana Labs, we do a weekly livestream called Grafana Office Hours, where we have guests on to talk about how to use Grafana, observability, or visualization. I saw your [blog post/video/post] on [source] and I think it would be great to have you on the show to share your experience about [topic]. Office Hours is an hour-long live conversation that is streamed to the [Grafana YouTube channel](https://youtube.com/@grafana). It's very casual, and you can also share your screen if you'd like to do a demo (not required). If you'd like to join, I'd love to have you! - [x] If the guest agrees, choose a date for the Office Hours session. Ask them for a photo you can use for promotion, or ask for permission to use their profile pic on social media. - [x] Invite them to the Grafana Office Hours calendar invite (choose "this instance only", not the whole series). Change the invite to include the episode number and their name, ie `Grafana Office Hours 01 with Mitch`. This is to save the date. - [x] Create a thumbnail. - [x] Schedule the broadcast on Streamyard, and select the Grafana YouTube channel as the destination. - [x] In the title, include the instance of Office Hours, i.e. `What's new in Grafana 10? (Grafana Office Hours #01)`. - [x] Add the standard description as per previous Grafana Office Hours shows. Check the video description and add guests' contact details. - [x] Get the Streamyard invite link and put it in the "location" of the calendar invite to the guest. - [x] Get the YouTube link to the show. - [ ] Create an event and announce it on Meetup. - [ ] Schedule a tweet just when the show begins to say "We're live now!" - [x] Schedule a Slack message on the internal Grafana workspace (in `#general`). - [x] Schedule a Slack message on the public Grafana Slack workspace (in `#grafana`) - [ ] Add timestamps to the video (at least four). - [ ] Add any links shared to the description of the video. - [ ] Add the video to video playlists that make sense (at the very least, the "Grafana Office Hours" one.) ### Just before the show - Before the show - [ ] How do you pronounce your name? (hinch-tchen) - [ ] Twitter handles - [ ] We will be using the talking points, but we don't have to be strict about it - [ ] Does anyone want to share their screen? We can do that now, and I can show you how that works - [ ] We'll be streaming to YouTube. - [ ] You'll be able to see comments, but if you have links, I have to paste it into the private chat - [ ] You can also use the private chat if you need to say something, but you can also just say it out loud - [ ] Afterwards, we'll say goodbye to the stream, but please stay on past that - [ ] Just in case I disconnect... stall for a minute and I'll be right back. ## Repurposing this content Consider reusing the content in other forms: - Blog post - Order the transcript from [Rev](https://rev.com) and post it on the blog, BUT with headings, subheadings, callouts, and summaries to make it more digestible. Embed the video into the blog post as well. - Shorter video - Edit the video into shorter, tutorial-style video(s) that we can repost and/or embed in documentation. - Docs article - Update any existing documentation.