Split web crawler & User traffic (setup infrastructure)

1

I am trying to split the traffic from web crawler and bots to SSR app for SEO and serve CSR app to users.

The one obviously way I can think of is to programmatically redirect the traffic based on user-agent but then even the CSR app will be server by node app (which might be waste of resources).

Is there any better way to achieve this?

2

We can’t think of a better way to achieve this. Have you found one since posting?

3

It might be worth investigating CloudFlare here as they may have a feature that could handle this before the request reaches us,

Regards,

John B

4

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.