And now, changes made to the back-end Proxy Server to increase performance
Key Changes Made:
Added express-rate-limit to limit requests from a single IP.
Integrated morgan for logging HTTP requests.
Added a simple endpoint to check the server’s status.
Implemented input validation for the URL using Joi.
Used dotenv for managing sensitive data like API keys and port configuration.
Enhanced error logging for debugging purposes.
Utilize a centralized error-handling middleware to manage errors in one place.
Use environment variables for more configuration options, such as cache duration or allowed origins, making it easier to change configurations without altering the code.
Use a middleware for handling static responses or messages instead of duplicating logic.
Add compression middleware to reduce the size of the response bodies, which can improve performance, especially for larger responses.
Handle timeouts for the requests made to the target URLs and provide appropriate error responses.
Implement security best practices, such as Helmet for setting HTTP headers, which can help protect against well-known vulnerabilities.
Improve logging with different levels (e.g., info, error) using a logging library like winston, which provides more control over logging output.
Implement graceful shutdown logic to handle server termination more smoothly, especially during deployment.
Integrate monitoring tools like Prometheus or an APM tool for better insights into the application’s performance and resource usage.
Use libraries like Joi or Ajv to validate responses sent back to the client, ensuring they conform to expected formats.
Again, this new code is running here in test for a few weeks.
Author of OGProxy, Swatch, Threaded, Card, and most of Sudonix's bugs…
wowww
Very good work my friend!!
@phenomlab the best of the best, great work Mark 
.
Seeing as not every site on the planet has relevant CORS headers that permit data scraping, I thought I’d make this a bit more obvious on the response. The link is still rendered, but by using the below if the remote site refuses to respond to request
Not entirely sold on the image yet - likely will change it, but you get the idea 
It’s more along the lines of graceful failure rather than a URL that simply does nothing.
Author of OGProxy, Swatch, Threaded, Card, and most of Sudonix's bugs…
@phenomlab I love that image and think it is perfect! LOL
@phenomlab said in OGProxy - a replacement for iFramely:
And now, changes made to the back-end Proxy Server to increase performance
Key Changes Made:
- Rate Limiting
Added express-rate-limit to limit requests from a single IP.
- Logging
Integrated morgan for logging HTTP requests.
- Health Check Endpoint
Added a simple endpoint to check the server’s status.
- Data Validation
Implemented input validation for the URL using Joi.
- Environment Variables
Used
dotenvfor managing sensitive data like API keys and port configuration.
- Error Handling
Enhanced error logging for debugging purposes.
- Asynchronous Error Handling
Utilize a centralized error-handling middleware to manage errors in one place.
- Environment Variable Management
Use environment variables for more configuration options, such as cache duration or allowed origins, making it easier to change configurations without altering the code.
- Static Response Handling
Use a middleware for handling static responses or messages instead of duplicating logic.
- Compression Middleware
Add compression middleware to reduce the size of the response bodies, which can improve performance, especially for larger responses.
- Timeout Handling on Requests
Handle timeouts for the requests made to the target URLs and provide appropriate error responses.
- Security Improvements
Implement security best practices, such as Helmet for setting HTTP headers, which can help protect against well-known vulnerabilities.
- Logging Configuration
Improve logging with different levels (e.g., info, error) using a logging library like winston, which provides more control over logging output.
- Graceful Shutdown
Implement graceful shutdown logic to handle server termination more smoothly, especially during deployment.
- Monitoring and Metrics
Integrate monitoring tools like Prometheus or an APM tool for better insights into the application’s performance and resource usage.
- Response Schema Validation
Use libraries like
JoiorAjvto validate responses sent back to the client, ensuring they conform to expected formats.Again, this new code is running here in test for a few weeks.
code updated on github or not ?
PW and WS Spirit alive
@DownPW Not yet. One or two bugs left to resolve, then it’ll be posted.
Ok I’ll install the old version in the meantime… Or maybe just wait if it’s not too long
@DownPW Coming soon…
@DownPW in the coming weeks.
