Uh, yes there is a SLIGHT problem with this: burning the house down. That fireplace was tested and listed under UL 127 with the mfrs. refractory panels. Not panels from another mfr. or bricks, or cement parging--just their refractory panels. All the test numbers on surface temps of nearby combustibles go out the window when you change the components as does the listing, warranty and probably your homeowners insurance. If this is attached to multi-family units, the fire marshal and AHJ could spank you for reckless endangerment of occupants and gross negligence. Having worked in the R&D test labs of the largest fireplace company in the world I can ASSURE you bricking up a firebox WILL significantly raise temps. and IS a fire hazard.
A test lab was testing some aftermarket panels made of densified vermuculite. They kept failing the test until the stamped brick pattern was glossy enough to reflect just enough heat to pass the test.
If the fireplace was made by Heatilator, you can still get OEM panels. They will cost a bit and take a few months but they are the safest and proper route to travel.
Or, you can provide me with job security investigating the fire. I'm being serious here. Don't do it, please.