Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

LearnedHand

(5,499 posts)
Fri Sep 13, 2024, 05:52 PM Sep 2024

PSA: How to scrub your URLs before posting and why it matters

WHY IT MATTERS: I’ll start here. All those weird characters in a URL mean and do something. They are parameters for behavioral and advertising trackers, and they send data to third-party databases for everyone who clicks the link. One reason we become DU star members is to avoid the advertising — and by extension, ad tracking — that otherwise funds DU. Not cleaning the URLs you post sort of subverts that.

HOW TO SCRUB A URL BEFORE YOU POST IT
1. Paste your URL into a DU post while composing but before you post it.
2. Locate the question mark near the front of the URL.
3. Select and delete the question mark and everything after it.
4. Copy the clean URL and paste it over your “dirty” URL.

EXAMPLE DIRTY URL
(URL fixed to not embed the tweet and spaced to show where trackers start) All the BOLD stuff here are the tracking parameters:
https [colon whack whack] x [dot] com/GaryPetersonUSA/status/1834561559210704969 ?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1834561559210704969%7Ctwgr%5Ec3db9ef910d3c46e40c0e3ca36296f6015f8dcd7%7Ctwcon%5Es1_&ref_url=https%3A%2F%2Fwww.miaminewtimes.com%2Fnews%2Fis-trump-having-an-affair-with-laura-loomer-the-far-right-extremist-21281352

SAME URL BUT SCRUBBED
https [colon whack whack] x [dot] com/GaryPetersonUSA/status/1834561559210704969

68 replies = new reply since forum marked as read
Highlight: NoneDon't highlight anything 5 newestHighlight 5 most recent replies
PSA: How to scrub your URLs before posting and why it matters (Original Post) LearnedHand Sep 2024 OP
Nice FirstLight Sep 2024 #1
It does because these parameter calls are browser-based LearnedHand Sep 2024 #4
It's recommended any time, any where you post a URL Random Boomer Sep 2024 #52
Thanks for the tip. Dave Bowman Sep 2024 #2
Thank you so very much for this. Bookmarked. I couldn't get this to post on fb today. I don't see the trackers. Are mahina Sep 2024 #3
This is what I see when I open the link LearnedHand Sep 2024 #7
Oh and to your question LearnedHand Sep 2024 #9
That video clip is amazing in terms of labelling. What movie is it from? niyad Sep 2024 #23
Isn't that a Captain America film? LearnedHand Sep 2024 #26
Wait no. It's Avengers: Endgame LearnedHand Sep 2024 #27
Thank you. Have never seen any of the Marvel/DC universes films. niyad Sep 2024 #28
I've seen all but the MULTIVERSE films LearnedHand Sep 2024 #29
I've been doing that for years... Dennis Donovan Sep 2024 #5
Exactly! LearnedHand Sep 2024 #8
Kick. Rec. Bookmark. Scrubbing URLs.... Hekate Sep 2024 #6
thanks.nt moniss Sep 2024 #10
Thanks. cachukis Sep 2024 #11
Thanks, I didn't know that ms liberty Sep 2024 #12
Neither did I! calimary Sep 2024 #39
To keep trackers and beacons off your own computer, consider running Ghostery Warpy Sep 2024 #13
Another good browser extension is Privacy Badger by Electronic Freedom Foundation LearnedHand Sep 2024 #14
Thanks to you, too Warpy Sep 2024 #16
"Taking out the trash" is right! LearnedHand Sep 2024 #21
I also like NoScript orthoclad Sep 2024 #63
It takes a finite number of processor cycles to jump over hurdles orthoclad Sep 2024 #65
I live to make life harder for thieves and cheats Warpy Sep 2024 #67
Thank you Wild blueberry Sep 2024 #15
Thanks for posting. I post about this a lot, but your post is more comprehensive. TwilightZone Sep 2024 #17
Honestly, it's hard to do this LearnedHand Sep 2024 #19
I guess the answer is to copy the link, paste it, and manually delete all the Igel Sep 2024 #42
Another reason - sometimes DU software doesn't render a usable link when there is all that junk progree Sep 2024 #18
Exactly right! LearnedHand Sep 2024 #22
Thank you Picaro Sep 2024 #20
Also works on YouTube videos and social media sites MagickMuffin Sep 2024 #24
You're exactly right LearnedHand Sep 2024 #25
Somebody posted about this a long time back (when I was just lurking) and the advice helped for a while RidinWithHarris Sep 2024 #30
So you're saying... tavernier Sep 2024 #31
only ifyou are on firefox lol nt et tu Sep 2024 #34
Always helpful, but advertisers don't care LearnedHand Sep 2024 #40
Thank you orthoclad Sep 2024 #32
I saw that the other day LearnedHand Sep 2024 #41
When I do have to break down and get a snarkphone, orthoclad Sep 2024 #61
Thanks, I didn't know this! LiberalLoner Sep 2024 #33
Thank you. SharonAnn Sep 2024 #35
I do that with YouTube links. SleeplessinSoCal Sep 2024 #36
book marked.....nt DoBW Sep 2024 #37
Re. Scrubbing urls: many thanks. B.See Sep 2024 #38
Thanks. Igel Sep 2024 #43
It's a shortcut we use in IT when describing URLs LearnedHand Sep 2024 #46
ifbyoudelrte the URl ... DoBW Sep 2024 #47
This one has no "?" but I believe it's tracking software KS Toronado Sep 2024 #44
No I think not actually LearnedHand Sep 2024 #45
Yet another reason to use FireFox (nee Mozilla) which has right-click "Copy Link Without Site Tracking" SorellaLaBefana Sep 2024 #48
Oh god bagimin Sep 2024 #49
Thanx for clarifying that. JohnnyRingo Sep 2024 #50
Thank you for the effort... One additional thing: Pluvious Sep 2024 #51
Great advice! LearnedHand Sep 2024 #60
I use postimage.cc all the time here to post images wolfie001 Sep 2024 #53
This looks like a clean URL LearnedHand Sep 2024 #62
Thank you!!! wolfie001 Sep 2024 #66
Thanks for the tip. generalbetrayus Sep 2024 #54
Is there a way to copy an URL to paste elsewhere but make it play on the page instead of going to X? (nt) SidneyR Sep 2024 #55
Thanks LearnedHand for this post and FemDemERA Sep 2024 #56
Thanks! SalviaBlue Sep 2024 #57
Thank you! Very good information. Easterncedar Sep 2024 #58
Good point. Good tutorial. Good advice. SpankMe Sep 2024 #59
I wondered about that myself LearnedHand Sep 2024 #64
Kick Auggie Feb 2 #68

FirstLight

(15,771 posts)
1. Nice
Fri Sep 13, 2024, 05:54 PM
Sep 2024

Wonder if this works in all platforms? or are the algorithms too imbedded?

I have no idea how it works but I'm down to learn

LearnedHand

(5,499 posts)
4. It does because these parameter calls are browser-based
Fri Sep 13, 2024, 05:59 PM
Sep 2024

Meaning they are embedded in the links, and when you click the link your browser sends a response to the distant database. It’s an opaque concept to be sure, but it helps develop good browsing hygiene to be aware that all our device browsers do this.

Random Boomer

(4,405 posts)
52. It's recommended any time, any where you post a URL
Sat Sep 14, 2024, 01:14 PM
Sep 2024

I've always pasted my URLs into Notepad, cleared out the tracking garbage, then copied again to paste into whatever platform post I'm making.

mahina

(20,645 posts)
3. Thank you so very much for this. Bookmarked. I couldn't get this to post on fb today. I don't see the trackers. Are
Fri Sep 13, 2024, 05:58 PM
Sep 2024

They always found after a ? Mahalo nui! (many thanks!)


LearnedHand

(5,499 posts)
7. This is what I see when I open the link
Fri Sep 13, 2024, 06:04 PM
Sep 2024

I’m changing the URL a little so the tweet doesn’t embed again. Everything in bold strikethrough below represents the trackers:

https [colon whack whack] x [dot] com/CalltoActivism/status/1834387610115985472?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%
5E1834387610115985472%7Ctwgr%5E24b193bdc7b4e6fdd14f2802167f47ee7505fd95%7Ctwcon
%5Es1_&ref_url=https%3A%2F%2Fwww.democraticunderground.com%2F100219458740

LearnedHand

(5,499 posts)
9. Oh and to your question
Fri Sep 13, 2024, 06:11 PM
Sep 2024

I think so? The question mark is typically the indicator, but I don’t know if it is always the indicator. Personally, if I’m unsure of a URL, I delete the question mark and everything after it and try it. If it opens the expected page, you have scrubbed out trackers. If the expected page doesn’t open, it somehow was part of the page call itself. For example, shopping site URLs typically have question marks before the product you’re browsing. In this case, the question mark is important.

LearnedHand

(5,499 posts)
29. I've seen all but the MULTIVERSE films
Fri Sep 13, 2024, 07:09 PM
Sep 2024

The sort of lost me there. I’m a huge fan of the films up through Infinity Wars though. I just thought that clip was from one of Cap’s solo films at first.

Dennis Donovan

(31,059 posts)
5. I've been doing that for years...
Fri Sep 13, 2024, 06:00 PM
Sep 2024

especially if they contain "source=twitter" - counts as an engagement or "click" for Elmo's "X" (which is how he lures advertisers) and I refuse to give him engagements from DU.

Hekate

(100,133 posts)
6. Kick. Rec. Bookmark. Scrubbing URLs....
Fri Sep 13, 2024, 06:03 PM
Sep 2024

Thanks!

PSA: How to scrub your URLs before posting and why it matters

WHY IT MATTERS: I’ll start here. All those weird characters in a URL mean and do something. They are parameters for behavioral and advertising trackers, and they send data to third-party databases for everyone who clicks the link. One reason we become DU star members is to avoid the advertising — and by extension, ad tracking — that otherwise funds DU. Not cleaning the URLs you post sort of subverts that.

HOW TO SCRUB A URL BEFORE YOU POST IT
1. Paste your URL into a DU post while composing but before you post it.
2. Locate the question mark near the front of the URL.
3. Select and delete the question mark and everything after it.
4. Copy the clean URL and paste it over your “dirty” URL.

EXAMPLE DIRTY URL
(URL fixed to not embed the tweet and spaced to show where trackers start) All the BOLD stuff here are the tracking parameters:
https [colon whack whack] x [dot] com/GaryPetersonUSA/status/1834561559210704969 ?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1834561559210704969%7Ctwgr%5Ec3db9ef910d3c46e40c0e3ca36296f6015f8dcd7%7Ctwcon%5Es1_&ref_url=https%3A%2F%2Fwww.miaminewtimes.com%2Fnews%2Fis-trump-having-an-affair-with-laura-loomer-the-far-right-extremist-21281352

SAME URL BUT SCRUBBED
https [colon whack whack] x [dot] com/GaryPetersonUSA/status/1834561559210704969

calimary

(90,021 posts)
39. Neither did I!
Fri Sep 13, 2024, 08:51 PM
Sep 2024

But I have been noticing these long-ass links lately with the letter-and-number gobbledygook.

Now, I’ll just look for the question mark, and delete from there.

Warpy

(114,615 posts)
13. To keep trackers and beacons off your own computer, consider running Ghostery
Fri Sep 13, 2024, 06:30 PM
Sep 2024

If you can set your browser to delete cookies, history and cache when you close it, consider that.

If you must visit dodgy websites, use a VPN with antivirus.

I have no illusions about being untraceable on the web. I just don't make it easy for them.

LearnedHand

(5,499 posts)
14. Another good browser extension is Privacy Badger by Electronic Freedom Foundation
Fri Sep 13, 2024, 06:33 PM
Sep 2024

It doesn’t block ads, so you’ll want to also run an ad blocker, but Privacy Badger scrubs all those trackers like Ghostery. Thanks Warpy!

Warpy

(114,615 posts)
16. Thanks to you, too
Fri Sep 13, 2024, 06:44 PM
Sep 2024

Ghostery has worked so well for me for several years that I hadn't gone searching for another program.

I was a very early user of Ghostery back in the day. It did a great job of taking out the trash to the point that neither Google nor YouTube knew who the hell I was any more. I liked that. I do have to parse my searches a little more carefully.

LearnedHand

(5,499 posts)
21. "Taking out the trash" is right!
Fri Sep 13, 2024, 06:55 PM
Sep 2024

I used to use Ghostery until I found out about Privacy Badger. I really like the work EFF does, and I appreciate all the tools they put in citizens’s hands to protect themselves. If anyone wants to learn more about self-protection on the internet, I recommend EFF’s Surveillance Self Defense.

https://www.eff.org/pages/surveillance-self-defense

orthoclad

(4,728 posts)
63. I also like NoScript
Sat Sep 14, 2024, 06:31 PM
Sep 2024

Much surveillance needs to run a script to work, like the Meta tracking pixel. NoScript can block them.

orthoclad

(4,728 posts)
65. It takes a finite number of processor cycles to jump over hurdles
Sat Sep 14, 2024, 06:34 PM
Sep 2024

Overload the spy computers by making it harder.

Warpy

(114,615 posts)
67. I live to make life harder for thieves and cheats
Sat Sep 14, 2024, 07:25 PM
Sep 2024

and advertisers who use services I pay for to try to spy on me to target advertising (pr worse) are both.

TwilightZone

(28,836 posts)
17. Thanks for posting. I post about this a lot, but your post is more comprehensive.
Fri Sep 13, 2024, 06:44 PM
Sep 2024

I usually just say "delete everything after the ?"

LearnedHand

(5,499 posts)
19. Honestly, it's hard to do this
Fri Sep 13, 2024, 06:51 PM
Sep 2024

If you press the Share button on a mobile device, you might not even notice the URL contains all this extra stuff. Also, it’s really hard to be vigilant, and It takes much more work. I’m just hoping to demystify it a little.

Igel

(37,535 posts)
42. I guess the answer is to copy the link, paste it, and manually delete all the
Fri Sep 13, 2024, 10:02 PM
Sep 2024

track-related portion of the URL.

progree

(12,977 posts)
18. Another reason - sometimes DU software doesn't render a usable link when there is all that junk
Fri Sep 13, 2024, 06:50 PM
Sep 2024

Last edited Fri Sep 13, 2024, 07:22 PM - Edit history (1)

in it.

And oftentimes I want the URL to show so people know exactly what they are clicking, and I want it to appear (and be) clean, not 4 lines of mostly worthless junk which might not work anyway when click on it.

e.g. a clean and transparent links:
https://finance.yahoo.com/
https://www.cmegroup.com/markets/interest-rates/cme-fedwatch-tool.html

ETA - and when the link is exposed, it also can be scraped and pasted to somewhere else (a Word file, notepad file, another post, whatever) and it shows, which is usually what I want.

LearnedHand

(5,499 posts)
22. Exactly right!
Fri Sep 13, 2024, 06:56 PM
Sep 2024

It’s also the reason there are visible characters after an embedded tweet or video or image. DU doesn’t embed the tracker portion of those URLs, so they hang out visible after the embedded thing.

MagickMuffin

(18,318 posts)
24. Also works on YouTube videos and social media sites
Fri Sep 13, 2024, 06:59 PM
Sep 2024


I figured it out after posting, you can see the ? once you post something. I then went deleted everything after the ? And everything worked fine!


Thanks for helping the forum!



RidinWithHarris

(790 posts)
30. Somebody posted about this a long time back (when I was just lurking) and the advice helped for a while
Fri Sep 13, 2024, 07:13 PM
Sep 2024

It's good to see a refresher.

tavernier

(14,443 posts)
31. So you're saying...
Fri Sep 13, 2024, 07:50 PM
Sep 2024

Lighting a bundle of sage in the room and chanting repeated phrases of wisdom from Dylan aren’t as effective?

Hmm.

LearnedHand

(5,499 posts)
40. Always helpful, but advertisers don't care
Fri Sep 13, 2024, 09:10 PM
Sep 2024

Freaking sharks are always looking to defeat our protections. As someone said above, we can’t be completely invisible, but we can sometimes make it more annoying for them.

orthoclad

(4,728 posts)
32. Thank you
Fri Sep 13, 2024, 08:01 PM
Sep 2024

The net is corporate surveillance hell. We don't need to help them.

For example, read this article:
https://www.theguardian.com/commentisfree/article/2024/sep/04/yes-it-sounds-like-a-conspiracy-theory-but-maybe-our-phones-really-are-listening-to-us

Despite the fact pretty much everyone has a story involving chatting about something only to see an ad for that something pop up on a device, the idea that your phone actively listens to you has long been dismissed as silly. After all, brands don’t need to eavesdrop like that – they already have access to millions of data points that build up a detailed picture of your habits and predicted purchases.
...
404 Media, a tech-focused news site, recently got hold of a pitch deck from Cox Media Group (CMG), touting its “Active Listening” software, which targets adverts based on what people say near their device microphones. The presentation doesn’t specify whether this voice data comes from smart TVs, smart speakers, or smartphones but the slide where it extols “the power of voice (and our devices’ microphones)” has a picture of people looking at their phones.


Follow some of the links in the article for truly hair-raising reading. Do we really think this listening will be confined to just sending us ads?

(edit: I use a landline and a flip phone, have no "smart" devices, and disable Siri and Alexa on all computers - at least I hope they're disabled.)

LearnedHand

(5,499 posts)
41. I saw that the other day
Fri Sep 13, 2024, 09:12 PM
Sep 2024

I do have a smart phone and use it exclusively (no landline). But I do try to make it harder for the surveillance capitalism to work.

orthoclad

(4,728 posts)
61. When I do have to break down and get a snarkphone,
Sat Sep 14, 2024, 06:28 PM
Sep 2024

I will strip it of apps and try to find a physical mike mute (tape doesn't work well). I don't trust software indicators showing the mike off, easy to fake them.

It's getting difficult to operate with a computer. Very little new software for desktop machines.

I miss having separate mikes and cameras I can unplug. I favor refurb hardware and old OS's, from earlier times ( like 2 years ago, snark).

Landlines are protected by wiretap laws. It takes a court order to legally listen in. Anything cellular, tho, is open to anybody at all, no warrant, no court order. Police commonly use a device called a Scorpion to spoof cell towers and listen to conversations. Anybody can buy a Scorpion and use it.

We're moving into a police state with a grin on our face. We need a wiretap law for cellular, including most internet connections these days.

SleeplessinSoCal

(10,412 posts)
36. I do that with YouTube links.
Fri Sep 13, 2024, 08:30 PM
Sep 2024

Maybe because of being slightly OCD and not liking the extra characters. Thanks for filling us in on what they do.

Igel

(37,535 posts)
43. Thanks.
Fri Sep 13, 2024, 10:06 PM
Sep 2024

(This isn't a word I often use online.)

Useful info, and info from the thread's already implemented.

But part of me is especially grateful because now I have a short word for "backslash": "whack."

I rather like how "whack whack dot" rolls off the tongue and can be slightly re-emphasized to tell a recalcitrant HS senior a URL that I've already said a half-dozen times.

KS Toronado

(23,727 posts)
44. This one has no "?" but I believe it's tracking software
Sat Sep 14, 2024, 12:52 AM
Sep 2024

hXtXtXpXsX:X/X/Xblogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjULBPpGCaIFxwHxwGTmWahvYdphylNeTdAxi35HZpI4G7wNiNaT0ubNG9z5V-BExeJ9H9covzDGyu7xSHNH_kXytMCYIoJIK9jadmMpWBekjEMWmlF9oNwehjUBCW8PKrPrVc7UFE7HIquJSkjYGdNu0DD_qPQk4SPt2mjUd9Ik38Q95ibmrL3VfDh16xJ/w473-h468/2c94ccf3-a8a8-4733-975b-9d94b54af547_362x358.jpg

What to erase here?

LearnedHand

(5,499 posts)
45. No I think not actually
Sat Sep 14, 2024, 02:09 AM
Sep 2024

The URL itself is wack, but if you look all the way to the end it ends with “.jpg”. This is literally how the browser translates googles URLs to their photos, maybe in someone’s google drive or maybe a search?

SorellaLaBefana

(509 posts)
48. Yet another reason to use FireFox (nee Mozilla) which has right-click "Copy Link Without Site Tracking"
Sat Sep 14, 2024, 09:59 AM
Sep 2024

Just saying...

Admittedly, am writing this on Chrome tho, since The Google still actively breaks many sites which do not use Chrome.

There are right-click extensions for Chrome, some of which (I believe) may allow for similar behaviour—however try to avoid extensions when possible.

Do use FF on morning startup, as always begin with the same sites (which all work w FF, else they get dropped), and often find myself sending links

Pluvious

(5,395 posts)
51. Thank you for the effort... One additional thing:
Sat Sep 14, 2024, 12:32 PM
Sep 2024

I always test the trimmed URL, to affirm none of the query parameters of the URI are required for a successful request

Cheers

wolfie001

(7,667 posts)
53. I use postimage.cc all the time here to post images
Sat Sep 14, 2024, 01:31 PM
Sep 2024

Can someone please decipher this url and let me know if I have to do any thinning out? Obviously, there's no question mark. Thanks

*********https //i.postimg.cc/cJkRSTwx/Baby-Huey-publicity-cel-600.jpg

generalbetrayus

(1,858 posts)
54. Thanks for the tip.
Sat Sep 14, 2024, 01:37 PM
Sep 2024

As a star member, I still get ads off and on. I'm not sure, but maybe it happens after I post a URL.

SidneyR

(212 posts)
55. Is there a way to copy an URL to paste elsewhere but make it play on the page instead of going to X? (nt)
Sat Sep 14, 2024, 02:02 PM
Sep 2024

FemDemERA

(828 posts)
56. Thanks LearnedHand for this post and
Sat Sep 14, 2024, 02:17 PM
Sep 2024

To all the others adding helpful tips. Bookmarking this one. 😊

SpankMe

(3,720 posts)
59. Good point. Good tutorial. Good advice.
Sat Sep 14, 2024, 03:19 PM
Sep 2024

Last edited Sun Sep 15, 2024, 12:16 PM - Edit history (1)

I discovered and learned about query strings with the question mark separator a couple of years ago and have been sanitizing my URL's ever since.

What would be nice is if there was some kind of scrubber in the forum software that would remove the separator and query string automatically when the preview and post buttons were pressed.

LearnedHand

(5,499 posts)
64. I wondered about that myself
Sat Sep 14, 2024, 06:32 PM
Sep 2024

I don’t think the forum software has any such functionality, but someone above mentioned a browser extension that will do this. It’s worth investigating!

Latest Discussions»General Discussion»PSA: How to scrub your UR...