Happened to me once or twice during this part of the relic for me. It is a little frustrating but not something I felt crippled me wanting to complete. As long as it's not happening during every book you do; you should be fine.