Split web crawler & User traffic (setup infrastructure)

I am trying to split the traffic from web crawler and bots to SSR app for SEO and serve CSR app to users.

The one obviously way I can think of is to programmatically redirect the traffic based on user-agent but then even the CSR app will be server by node app (which might be waste of resources).

Is there any better way to achieve this?

We can’t think of a better way to achieve this. Have you found one since posting?

It might be worth investigating CloudFlare here as they may have a feature that could handle this before the request reaches us,


John B

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.