OK, now I got informed through Email (thanks for quick support) that the origin of the issue was a subtle redirect.
In fact, I set https://www.my-website.com/en and it was redirected to https://www.my-website.com/en/ and that trailing slash required an 301 and āblockedā the crawler from working
My suggestion is:
- Couldnāt the crawler be improved so that it ignores 301 as long as the domain stays the same?
- In all cases, I think it would be nice to include this detail in documentation
thanks again