Run PCP function to test plugin in plugin submission process

[barrykooij]

When a user submits a new plugin to the directory, we want to run a function within PCP which checks if the new submission passes a collection of automated checks. If not, we want to block the submission and inform the user why.

The first version within PCP would be a set of PHPCS rules that are always blocking. Later we can expand on this with for example a readme parser. We are discussing what PHPCS rules should be included on Github: ​ https://github.com/WordPress/plugin-check/issues/440

This trac ticket is to talk about if this is possible and how we can do this.

[dd32]

To integrate it...

The minimum we need to know is:

• Whether this plugin is a PASS or FAIL.
• Any errors/warnings/notes etc.

A pass with a long list of errors is acceptable, if those errors might be false-positives, as long as we have a way of knowing that it's a PASS/FAIL.

What we need code wise:

• A function (or class method, or even WP-CLI command!) that can be provided an arbritrary folder on disk (ie. /tmp/plugin-submission-123oeiwlsf ), any metadata about the plugin needed (ie. WordPress.org uploader name), and can return the above information.