I finally realized that this ought to exist. And sure enough, it had been constructed already: the *4d supergravity Lie 2-algebra*-extension of the 4d $N = 2$ super-Poincaré super-Lie algebra. I have added a minimum of an Idea-section and pointers to the references.