Refactor configuration loading to parse profile files only once (#2152)

* Draft PR to only parse configuration once

* Update docs & and add test

* Fix bug where cache was being cleared by mistake

* Add additional docs

* Apply suggestions from code review

Co-authored-by: Zelda Hessler <zhessler@amazon.com>

* Apply suggestions from code review

Co-authored-by: Zelda Hessler <zhessler@amazon.com>

* fix name of field

Co-authored-by: Zelda Hessler <zhessler@amazon.com>