Select your Platform:
Scrape URLs
Confused about "Scrape URLs"?
Let us know how we can improve our documentation:
LAST EDIT Nov 30 2023
- On This Page:
- User agents
This endpoint allows you to retrieve open graph information from a URL which you can then use to add images and a description to activities. For example:
Returns the following:
Some URLs from popular services such as Instagram, Youtube, etc. resolve to their CDN and they have signatures on them which expire after some time. There is no clear information on when these links expire. However, if you think your older data requires these links to stay valid, please consider refreshing the open graph data by calling this endpoint and updating your metadata.
User agents
Copied!Confused about "User agents"?
Let us know how we can improve our documentation:
Our scraper uses the following user agent, as well as the latest desktop and mobile user agents: getstream.io/opengraph-bot facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
If you plan to scrape any links to websites you can control, please ensure that this user agent isn't blocked and returns valid opengraph data, for the best results.
