I would suggest a separate sub-forum on RogueTemple (we all have access already, and a pubic forum invites normal players to join in on discussion), with a thread on each game, and an impulse for everyone to update by the end of the month and to critically analyse someone else's work by the end of each month. You may not succeed every month but you can at least try.
Focus should be on games with releasable material. Might be buggy and incomplete, but it needs to be playable. Open source and cross-platform is not required, but should be encouraged as it makes for easier feedback.
Every game must have goals on what it's trying to be, in terms of scope, novelty, desired content, etc. Of course we can suggest to each other a change of goals.
Emphasis on constructive criticism and suggestions for improvements. Can include suggestions for cutting, adding or editing material or mechanics. Devs should also highlight the goods things in the works, so that these aspects are preserved through the update process.
Membership should be open really, with the caveat that if you don't review other people's games then they're not likely to review yours. Operate on a quid pro quo basis. We can keep a Google Spreadsheet to tally who has reviewed what which months and determine if some people aren't pulling their weight, or if some games are getting too much attention at the expense of others.
As a developer looking at other people's works is always great (I always get loads of new games ideas from judging the 7DRLs), and having devs look at your work can provide some very insightful feedback.
As a near term aim getting a package of polished games for ARRP would be excellent.
I would like to formally submit Rogue Rage to this process. It is currently incomplete but very playable, and I'll look to get a more complete build ready before we properly start this.