an addon for blending vertex color layers into a single target
INSTALLATION
Install the addon by placing it in the scripts/addons directory or by clicking "install from file" in user preferences. Once installed, make sure it's activated. The addon is called "Render: Vertex Diffuse Bake"
WHY VERTEX COLORS
Vertex colors are floats stored in the mesh data along with the position data. They can be used to add color variation to textured models, add lighting or ambient occlusion effects to models, or to store special information that a shader uses (vertex alpha, texture splatting, etc.), many games use vertex colors almost exclusively, and in the right hands it can be a memorable art style.
Blender has nice tools for manually painting vertex colors on a mesh, and you can render bake to a vertex color target which works well for ambient occlusion or lighting renders, but it's a lot of setup to get a final result of lighting, ambient occlusion, and color data baked together in the right amounts.
I decided to make a compositor for vertex color layers, an addon that could mix and blend instances of the vcol layer data and compile them into a single target.
USAGE
the Vertex Bake UI is in the Render buttons panel
the combined vertex results are written to the 'Col' layer, you should have this layer set to visible, but not part of the bake stack
light and ao baking writes to LIGHT and AO layers (they should be created automatically), but you can set a custom target in the Vertex Bake UI panel (as long as it's an existing layer!)
'add layer pass' will add a layer to the mixing stack, you can change the source vcol data.
Use the edge split modifier to get hard edges for vetex light baking
You have to rebake lighting and/or ao every time you make changes to the scene
if you want to save the combined output, rename the Col layer and make a new 'Col' to replace it.
When using GLSL shading mode, you'll need to check 'Vertex Color Paint' in the object material buttons to see vertex colors in the viewport
typically you want to set the material to 'shadeless' so see the vcol output without realtime lighting applied
A basic stack recipie is to mix ao and lighting, then multiply a color layer
remember you can still paint manually on any of the layers, this is useful for removing AO artifacts and other fine tweaks
ISSUES
overlay blending mode currently doesn't use blending weight
You may need to apply rotation and scale before baking.
The chain icon is supposed to convert a layer into a mask for how the previous and next layers mix, but it doesn't work right at the moment
'Add color pass' is not functional yet, it will eventually add a solid color layer/