This might be a little gung-ho, but I'd take the entire knife apart to repair that. Start by gently removing the broken parts of the scale that are loose then drill the rivets to remove the rest.
Clean all the knife parts.
Use thin CA to repair the scale may be backed on to some masking tape to keep together, then refinish the scale and polish appropriately and sand off remaining masking paper.
Reassemble with new pivots.
Obviously sounds easier than it looks but that's what I'd do.