- 浏览: 27014 次
- 性别:
- 来自: 上海
-
文章分类
最新评论
转摘与:http://okita.com/alex/
SCNTechnique in SceneKit
New in ios8 is the SCNTechnique. It’s a way to get your models to pass through a custom shader program. This is an added layer on top of an objects filters. For instance, you’re able to apply a Gaussian blur to a single node in a SceneKit scene, then pass the scene to a fragment shader to change the color of the scene.
新的ios8 SCNTechnique技术。这是一种让你的模型通过一个自定义着色器程序。这是一个添加过滤器层上的一个对象。例如,你能够应用高斯模糊SceneKit现场单个节点,然后通过场景片段着色器改变现场的颜色。
Getting started I’m setting up a new ios game.
1、开始我设置一个新的ios游戏。
[img][/img]
This will create the scene view that SceneKit uses to render it’s 3d objects to. I’ve named the project SCNTechnique, this will make it obvious what this project is being used for.
2、这将创建SceneKit使用的场景视图呈现它的3 d对象。我将该项目命名为“SCNTechnique,这将使它明显被用于这一项目。
I’m also enabling the local source control, I think git is required for this to work. If you don’t have this then I suggest you use it. If you break something it’s useful to know what you changed.
3..
In the project we’ll want to set up a new dictionary that’s used to reference and define data going to and from the SCNTechnique rendering pass. I’m adding an iOS property list. Selecting add new file to the project to open this choose a template for your new file dialog:
4、项目中我们想要建立一个新的字典,用来引用和定义数据和从SCNTechnique呈现通过。我添加一个iOS属性列表。选择将新文件添加到项目中打开这个为你的新文件对话框:选择一个模板
Then I’m naming it firstPass, it’ll add the plist file extension for me. A property list is an XML file which Xcode allows us to edit with a more friendly interface.
5、然后我给它命名firstPass,它会增加我的plist文件扩展名。一个Xcode属性列表是一个XML文件允许我们编辑更友好的界面。
The file appears with Root as the only section of data. We need to populate this with a few things to turn it into something that can be used by SCNTechnique. There are three entries [sequence, passes, symbols] where sequence is an Array and passes and symbols are both Dictionaries. These are added with the plus icon, and the type is changed with a popup menu under the type column.
6、文件只出现与根部分的数据。我们需要填充这几件事,把它变成SCNTechnique可以使用的东西。有三个条目(序列,通过符号),序列是一个数组,通过和符号都是字典。这些添加的加号图标,弹出菜单的类型是改变类型列。
sequence defines what pass is rendered when. To be honest, I think this means that you can define multiple passes in a single SCNTechnique, but so far this seems to be quite buggy and I can’t seem to get more than one pass working. Passes defines what parameters are passed to and from the shader programs. We’ll get to shader programs in a moment. symbols defines what name and type the data is passed from your code into the shaders.
7、序列定义了通过时呈现。老实说,我认为,这意味着您可以定义多个传入一个SCNTechnique,但到目前为止,这似乎是相当车,我似乎无法得到不止一个传递工作。通过定义了参数传递的着色器程序。我们会着色器程序。符号定义了名称和类型的数据从您的代码传递到着色器。
So shader programs, I couldn’t find any appropriate templates to start with for these, so I ended up picking iOS/Other/Empty template. Which isn’t much of a template… But it is necessary to ensure that the project is aware of your new file. I added two files, a firstProgram.vsh and a firstProgram.fsh.
8、所以着色器程序,我找不到任何合适的模板,从这些开始,所以我最终选择iOS /其他/空模板。这并不是很大的模板…但它是必要的,以确保该项目是意识到自己的新文件。我添加了两个文件,一个firstProgram。太小,firstProgram.fsh。
These live in the project like so.
What is the fsh and vsh for? the fsh means fragment shader and the vsh means vertex shader. Basically these are common OpenGL type shader programs. To make the connection between these shader programs and SCNTechnique in your SceneKit scene you’ll need to add them to the firstPass.plist so back to defining the technique’s property list.
9、fsh和vsh是什么?fsh意味着片段着色器和太小意味着顶点着色器。基本上这些都是常见的OpenGL渲染程序类型。这些着色器程序之间的联系和SCNTechnique SceneKit场景你需要将它们添加到firstPass。plist所以回定义技术的属性列表。
In the Sequence array we need to name a rendering pass in the passes list. This seems to be the entry point for the technique. I’m naming it renderingPass.
10、序列数组中我们需要呈现通过通过列表中的名称。这似乎是入口点的技术。我命名它renderingPass。
This tells the Technique where to start. The item 0 of the sequence needs to point to an entry in the passes item. Then in passes we are require to have 4 entries.
11、这告诉技术从哪里开始。0项的序列需要指向一个条目的条目。然后在通过我们需要有4个条目。
draw program inputs and outputs, draw is a string program is another string and inputs and outputs are both dictionaries.
12、画程序输入和输出,平局是一个字符串的程序是另一个字符串,输入和输出都是字典。
draw needs to be set to DRAW_QUAD which is used to draw data piped into the shader program, we also have DRAW_NODE or DRAW_SCENE. Each is used for specific reasons, but for now we’ll use DRAW_QUAD. The program refers to the .vsh and .fsh files we created and added to the project a moment ago. (note: the case and underscore are important) Don’t add the .vsh or .fsh to the program, Technique knows what to do with the name. I’ll always look for both files, if one or the other are missing the Technique will fail and your app will stop when looking for the program.
13、将需要设置DRAW_QUAD用于将数据输送到着色器程序,我们也有DRAW_NODE或DRAW_SCENE。每个用于特定的原因,但现在我们将使用DRAW_QUAD。程序指的是。太小。fsh文件创建和添加到项目中。(注:和下划线)很重要不要添加。太小。fsh的项目,技术知道如何处理这个名字。我总是会找两个文件,如果一个或另一个缺少技术会失败,应用程序会停止当寻找项目。
It seems rather necessary that one of the inputs is COLOR which goes into a colorSampler. COLOR is an openGL data source and colorSampler will be available in the shader program with data coming from COLOR. the a_position is a variable which points to a_position-symbol. We will need to add this to the symbols section of the technique’s plist. So we’ll add that in next.
14、似乎而必要的输入是进了colorSampler颜色。颜色是一个openGL数据源和colorSampler将着色器程序中可用的数据来自颜色。a_position是一个变量,指向a_position-symbol。我们将需要添加这个符号部分技术的plist。所以接下来我们将添加进去。
In the a_position we add a_position-symbol and in symbols create a_position-symbol as a dictionary and add semantic vertex string to create a link between your SCNTechnique and the program. I’m not exactly sure why we don’t need to do this for colorSampler, but that’s how it works.
now we should add our code to both the .vsh and .fsh to make this work. In the firstProgram.fsh I’ve added the following code:
uniform sampler2D colorSampler;
varying vec2 uv;
void main()
{
vec4 color = texture2D(colorSampler, uv);
gl_FragColor = color;
}
This isn’t objective-c it’s c, and the colorSampler here is being piped in from the plist which SCNTechnique is using to tunnel data through. gl_fragColor is the final output to the fragment shader.
In the vsh we need to add in the following code:
attribute vec4 a_position;
varying vec2 uv;
void main(void)
{
uv = (a_position.xy + 1.0) * 0.5;
gl_Position = a_position;
}
The gl_Position is the final output for the vertices in the vertex shader. With these two parts of the firstProgram in place and the firstPass.plist setup we can now use it in the GameViewController.m
...
// configure the view
scnView.backgroundColor = [UIColor blackColor];
NSURL *url;
url = [[NSBundle mainBundle] URLForResource:@"firstPass" withExtension:@"plist"];
SCNTechnique *firstTechnique = [SCNTechnique techniqueWithDictionary:[NSDictionary dictionaryWithContentsOfURL:url]];
scnView.technique = firstTechnique;
...
In the template code we follow after the scnView is setup in the scene. Then we create a NSURL *url; to fill with url = [[NSBundle mainBundoe] URLForResource:@”firstPass” withExtension:@”plist”]; this makes a url that points to the firstPass.plist that we created with all of the data used to connect our shader program with the SCNTechnique. The we use SCNTechnique *firstTechnique to load in that dictionary. Finally we assign scnView.technique to the SCNTechnique we created from the plist.
IMG_0104
Horray, we’re drawing using a SCNTechnique, it doesn’t look like anything interesting is happening, but it’s really going through our shader program and not the usual scene.view. We can prove this by editing the shader program. We can draw the technique as red by changing the fsh to the following code.
uniform sampler2D colorSampler;
varying vec2 uv;
void main()
{
gl_FragColor = vec4(1.0, 0.0, 0.0, 0.0);
}
This sets the gl_fragColor to red. And now the iPad draws the image as all red. I’m still working on more interesting things to do with all of this but if you’re familiar with openGL then you’ll be able to do quite a lot. I’m not that familiar with openGL myself, so I’m learning what I can while I can. Hope this tutorial helps.
Read More
July 25, 2014
SceneKit shaderModifiers
So I started with the basic GameKit, this gives you a colorful jet object in the scene.
By default the code in the GameViewController.m looks like the following:
55
- (void)viewDidLoad
{
[super viewDidLoad];
// create a new scene
SCNScene *scene = [SCNScene sceneNamed:@"art.scnassets/ship.dae"];
// create and add a camera to the scene
SCNNode *cameraNode = [SCNNode node];
cameraNode.camera = [SCNCamera camera];
[scene.rootNode addChildNode:cameraNode];
// place the camera
cameraNode.position = SCNVector3Make(0, 0, 15);
// create and add a light to the scene
SCNNode *lightNode = [SCNNode node];
lightNode.light = [SCNLight light];
lightNode.light.type = SCNLightTypeOmni;
lightNode.position = SCNVector3Make(0, 10, 10);
[scene.rootNode addChildNode:lightNode];
// create and add an ambient light to the scene
SCNNode *ambientLightNode = [SCNNode node];
ambientLightNode.light = [SCNLight light];
ambientLightNode.light.type = SCNLightTypeAmbient;
ambientLightNode.light.color = [UIColor darkGrayColor];
[scene.rootNode addChildNode:ambientLightNode];
// retrieve the ship node
SCNNode *ship = [scene.rootNode childNodeWithName:@"ship" recursively:YES];
[ship runAction:[SCNAction repeatActionForever:[SCNAction rotateByX:0 y:0.2 z:0 duration:1]]];
// retrieve the SCNView
SCNView *scnView = (SCNView *)self.view;
// set the scene to the view
scnView.scene = scene;
// allows the user to manipulate the camera
scnView.allowsCameraControl = YES;
// show statistics such as fps and timing information
scnView.showsStatistics = YES;
// configure the view
scnView.backgroundColor = [UIColor blackColor];
// add a tap gesture recognizer
UITapGestureRecognizer *tapGesture = [[UITapGestureRecognizer alloc] initWithTarget:self action:@selector(handleTap:)];
NSMutableArray *gestureRecognizers = [NSMutableArray array];
[gestureRecognizers addObject:tapGesture];
[gestureRecognizers addObjectsFromArray:scnView.gestureRecognizers];
scnView.gestureRecognizers = gestureRecognizers;
}
There’s not much going on other than adding models, lights and cameras to the scene. I wanted to do some learning up on shaderModifiers so I started by getting the mesh in the ship.dae.
To do that I need to get to the material on the ship.
1
ship.geometry.firstMaterial
The above shows up with nothing, the ship included in the scene has no geometry in the ship node. This took a few minutes of fiddling before I found that the ship has a shipMesh child object.
Screen Shot 2014-07-25 at 6.48.44 PMThe child is called shipMesh, and that’s the node that would have a firstMaterial. To get to that I used
1
SCNNode *shipMesh = [ship childNodeWithName:@"shipMesh" recursively:YES];
The line assigns the actual mesh I need to get to the *shipMesh SCNNode object. now I can use the following:
1
SCNMaterial *mat = shipMesh.geometry.firstMaterial;
This assigns the shipMesh’s material to the SCNMaterial *mat so I can start adding shaderModifiers to the object in the scene.
Starting with the basics I tried out:
1
mat.shaderModifiers = @{SCNShaderModifierEntryPointFragment : @"_output.color.rgb = vec3(0.5);"};
this turned the ship to a grey color. on the iPad:
Screen Shot 2014-07-25 at 6.55.28 PMSo this was expected, vec3(0.5) tells GLSL to make a rgb color of r 0.5, g 0.5. b 0.5, it’s a handy short-hand for color making. Another thing I tried was the following.
1
mat.shaderModifiers = @{SCNShaderModifierEntryPointFragment : @"_output.color = vec4(0.5);"};
This wasn’t assigning color.rgb but color, which expects a vec4, and I got the same result; a grey jet appears on the iPad. Just to be thorough, I tried assigning an interesting value to the color.
1
mat.shaderModifiers = @{SCNShaderModifierEntryPointFragment : @"_output.color = vec4(0.5, 0.1, 0.2, 0.3);"};
The above turned into a reddish jet.
Screen Shot 2014-07-25 at 6.58.46 PM
So this again was expected. I took some code from the WWDC presentation and found some code to try out on the jet.
mat.shaderModifiers = @{SCNShaderModifierEntryPointGeometry : @"// Waves Modifier\n"
"float Amplitude = 1.2;\n"
"float Frequency = 5.0;\n"
"vec2 nrm = _geometry.position.xz;\n"
"float len = length(nrm)+0.0001; // for robustness\n"
"nrm /= len;\n"
"float a = len + Amplitude*sin(Frequency * _geometry.position.z + u_time * 10.0);\n"
"_geometry.position.xz = nrm * a;\n"};
The above made the jet all wobbly.
Screen Shot 2014-07-25 at 7.00.46 PMAll of the verts were going off of a sin(u_time) which is a value in the GLSL world that all shaders have access to. Cool stuff so far. After this I found some interesting car paint shader from the WWDC presentation and tweaked it to get the following result.
mat.shaderModifiers = @{SCNShaderModifierEntryPointSurface : @"\n"
"float flakeSize = sin(u_time * 0.2);\n"
"float flakeIntensity = 0.7;\n"
"vec3 paintColor0 = vec3(0.9, 0.4, 0.3);\n"
"vec3 paintColor1 = vec3(0.9, 0.75, 0.2);\n"
"vec3 flakeColor = vec3(flakeIntensity, flakeIntensity, flakeIntensity);\n"
"vec3 rnd = texture2D(u_diffuseTexture, _surface.diffuseTexcoord * vec2(1.0) * sin(u_time*0.1) ).rgb;\n"
"vec3 nrm1 = normalize(0.05 * rnd + 0.95 * _surface.normal);\n"
"vec3 nrm2 = normalize(0.3 * rnd + 0.4 * _surface.normal);\n"
"float fresnel1 = clamp(dot(nrm1, _surface.view), 0.0, 1.0);\n"
"float fresnel2 = clamp(dot(nrm2, _surface.view), 0.0, 1.0);\n"
"vec3 col = mix(paintColor0, paintColor1, fresnel1);\n"
"col += pow(fresnel2, 106.0) * flakeColor;\n"
"_surface.normal = nrm1;\n"
"_surface.diffuse = vec4(col.r,col.b,col.g, 1.0);\n"
"_surface.emission = (_surface.reflective * _surface.reflective) * 2.0;\n"
"_surface.reflective = vec4(0.0);\n"};
Screen Shot 2014-07-25 at 7.04.07 PMStrangely enough I didn’t delete the code that made the jet wobbly, so I’m guessing something was overwritten. The shaderModifiers is being assigned one value when we use = to assign the value an @{“”}; object. So a bit of looking at the shaderModifiers object in the materials and I see that it’s an NSDictionary. The NSMutableDictionary and NSDictionary are supposedly compatible, so I make a new NSMutableDictionary with the following:
1
NSMutableDictionary *shaders = [[NSMutableDictionary alloc]init];
I’ll use that and assign multiple keys with code to the *shaders dictionary.
this looks like the following:
NSMutableDictionary *shaders = [[NSMutableDictionary alloc]init];
shaders[SCNShaderModifierEntryPointGeometry] =
@"// Waves Modifier\n"
"float Amplitude = 1.2;\n"
"float Frequency = 5.0;\n"
"vec2 nrm = _geometry.position.xz;\n"
"float len = length(nrm)+0.0001; // for robustness\n"
"nrm /= len;\n"
"float a = len + Amplitude*sin(Frequency * _geometry.position.z + u_time * 10.0);\n"
"_geometry.position.xz = nrm * a;\n";
shaders[SCNShaderModifierEntryPointSurface] =
@"float flakeSize = sin(u_time * 0.2);\n"
"float flakeIntensity = 0.7;\n"
"vec3 paintColor0 = vec3(0.9, 0.4, 0.3);\n"
"vec3 paintColor1 = vec3(0.9, 0.75, 0.2);\n"
"vec3 flakeColor = vec3(flakeIntensity, flakeIntensity, flakeIntensity);\n"
"vec3 rnd = texture2D(u_diffuseTexture, _surface.diffuseTexcoord * vec2(1.0) * sin(u_time*0.1) ).rgb;\n"
"vec3 nrm1 = normalize(0.05 * rnd + 0.95 * _surface.normal);\n"
"vec3 nrm2 = normalize(0.3 * rnd + 0.4 * _surface.normal);\n"
"float fresnel1 = clamp(dot(nrm1, _surface.view), 0.0, 1.0);\n"
"float fresnel2 = clamp(dot(nrm2, _surface.view), 0.0, 1.0);\n"
"vec3 col = mix(paintColor0, paintColor1, fresnel1);\n"
"col += pow(fresnel2, 106.0) * flakeColor;\n"
"_surface.normal = nrm1;\n"
"_surface.diffuse = vec4(col.r,col.b,col.g, 1.0);\n"
"_surface.emission = (_surface.reflective * _surface.reflective) * 2.0;\n"
"_surface.reflective = vec4(0.0);\n";
mat.shaderModifiers = shaders;
The different SCNShaderModifierEntryPointGeometry and PointSurfaces are key values with objects assigned to them. At the end we assign mat.shaderModifiers = shaders to assign both of these objects in the NSMutableDictionary to the material. So now the final result looks like the following:
Screen Shot 2014-07-25 at 7.09.39 PM
A wobbly pink jet. The significance of all of this is that to apply multiple shaders to the object you need to create a dictionary first, and use the different entrypoint constant values as keys. Hope this all made sense.
Read More
June 18, 2014
Looking for some Unreal Stuff?
http://okita.com/alex/unreal-game-development-archive/
The archives and what’s been going on can be found on the link above. Updates and adventures will be forthcoming as well as a few project announcements.
IMG_20140610_083914Making the most of a small workshop means approaching a critical density of stuff. I need to organize this into something more sensible, and some cool gizmos will be coming to this site soon. Check back often!
SCNTechnique in SceneKit
New in ios8 is the SCNTechnique. It’s a way to get your models to pass through a custom shader program. This is an added layer on top of an objects filters. For instance, you’re able to apply a Gaussian blur to a single node in a SceneKit scene, then pass the scene to a fragment shader to change the color of the scene.
新的ios8 SCNTechnique技术。这是一种让你的模型通过一个自定义着色器程序。这是一个添加过滤器层上的一个对象。例如,你能够应用高斯模糊SceneKit现场单个节点,然后通过场景片段着色器改变现场的颜色。
Getting started I’m setting up a new ios game.
1、开始我设置一个新的ios游戏。
[img][/img]
This will create the scene view that SceneKit uses to render it’s 3d objects to. I’ve named the project SCNTechnique, this will make it obvious what this project is being used for.
2、这将创建SceneKit使用的场景视图呈现它的3 d对象。我将该项目命名为“SCNTechnique,这将使它明显被用于这一项目。
I’m also enabling the local source control, I think git is required for this to work. If you don’t have this then I suggest you use it. If you break something it’s useful to know what you changed.
3..
In the project we’ll want to set up a new dictionary that’s used to reference and define data going to and from the SCNTechnique rendering pass. I’m adding an iOS property list. Selecting add new file to the project to open this choose a template for your new file dialog:
4、项目中我们想要建立一个新的字典,用来引用和定义数据和从SCNTechnique呈现通过。我添加一个iOS属性列表。选择将新文件添加到项目中打开这个为你的新文件对话框:选择一个模板
Then I’m naming it firstPass, it’ll add the plist file extension for me. A property list is an XML file which Xcode allows us to edit with a more friendly interface.
5、然后我给它命名firstPass,它会增加我的plist文件扩展名。一个Xcode属性列表是一个XML文件允许我们编辑更友好的界面。
The file appears with Root as the only section of data. We need to populate this with a few things to turn it into something that can be used by SCNTechnique. There are three entries [sequence, passes, symbols] where sequence is an Array and passes and symbols are both Dictionaries. These are added with the plus icon, and the type is changed with a popup menu under the type column.
6、文件只出现与根部分的数据。我们需要填充这几件事,把它变成SCNTechnique可以使用的东西。有三个条目(序列,通过符号),序列是一个数组,通过和符号都是字典。这些添加的加号图标,弹出菜单的类型是改变类型列。
sequence defines what pass is rendered when. To be honest, I think this means that you can define multiple passes in a single SCNTechnique, but so far this seems to be quite buggy and I can’t seem to get more than one pass working. Passes defines what parameters are passed to and from the shader programs. We’ll get to shader programs in a moment. symbols defines what name and type the data is passed from your code into the shaders.
7、序列定义了通过时呈现。老实说,我认为,这意味着您可以定义多个传入一个SCNTechnique,但到目前为止,这似乎是相当车,我似乎无法得到不止一个传递工作。通过定义了参数传递的着色器程序。我们会着色器程序。符号定义了名称和类型的数据从您的代码传递到着色器。
So shader programs, I couldn’t find any appropriate templates to start with for these, so I ended up picking iOS/Other/Empty template. Which isn’t much of a template… But it is necessary to ensure that the project is aware of your new file. I added two files, a firstProgram.vsh and a firstProgram.fsh.
8、所以着色器程序,我找不到任何合适的模板,从这些开始,所以我最终选择iOS /其他/空模板。这并不是很大的模板…但它是必要的,以确保该项目是意识到自己的新文件。我添加了两个文件,一个firstProgram。太小,firstProgram.fsh。
These live in the project like so.
What is the fsh and vsh for? the fsh means fragment shader and the vsh means vertex shader. Basically these are common OpenGL type shader programs. To make the connection between these shader programs and SCNTechnique in your SceneKit scene you’ll need to add them to the firstPass.plist so back to defining the technique’s property list.
9、fsh和vsh是什么?fsh意味着片段着色器和太小意味着顶点着色器。基本上这些都是常见的OpenGL渲染程序类型。这些着色器程序之间的联系和SCNTechnique SceneKit场景你需要将它们添加到firstPass。plist所以回定义技术的属性列表。
In the Sequence array we need to name a rendering pass in the passes list. This seems to be the entry point for the technique. I’m naming it renderingPass.
10、序列数组中我们需要呈现通过通过列表中的名称。这似乎是入口点的技术。我命名它renderingPass。
This tells the Technique where to start. The item 0 of the sequence needs to point to an entry in the passes item. Then in passes we are require to have 4 entries.
11、这告诉技术从哪里开始。0项的序列需要指向一个条目的条目。然后在通过我们需要有4个条目。
draw program inputs and outputs, draw is a string program is another string and inputs and outputs are both dictionaries.
12、画程序输入和输出,平局是一个字符串的程序是另一个字符串,输入和输出都是字典。
draw needs to be set to DRAW_QUAD which is used to draw data piped into the shader program, we also have DRAW_NODE or DRAW_SCENE. Each is used for specific reasons, but for now we’ll use DRAW_QUAD. The program refers to the .vsh and .fsh files we created and added to the project a moment ago. (note: the case and underscore are important) Don’t add the .vsh or .fsh to the program, Technique knows what to do with the name. I’ll always look for both files, if one or the other are missing the Technique will fail and your app will stop when looking for the program.
13、将需要设置DRAW_QUAD用于将数据输送到着色器程序,我们也有DRAW_NODE或DRAW_SCENE。每个用于特定的原因,但现在我们将使用DRAW_QUAD。程序指的是。太小。fsh文件创建和添加到项目中。(注:和下划线)很重要不要添加。太小。fsh的项目,技术知道如何处理这个名字。我总是会找两个文件,如果一个或另一个缺少技术会失败,应用程序会停止当寻找项目。
It seems rather necessary that one of the inputs is COLOR which goes into a colorSampler. COLOR is an openGL data source and colorSampler will be available in the shader program with data coming from COLOR. the a_position is a variable which points to a_position-symbol. We will need to add this to the symbols section of the technique’s plist. So we’ll add that in next.
14、似乎而必要的输入是进了colorSampler颜色。颜色是一个openGL数据源和colorSampler将着色器程序中可用的数据来自颜色。a_position是一个变量,指向a_position-symbol。我们将需要添加这个符号部分技术的plist。所以接下来我们将添加进去。
In the a_position we add a_position-symbol and in symbols create a_position-symbol as a dictionary and add semantic vertex string to create a link between your SCNTechnique and the program. I’m not exactly sure why we don’t need to do this for colorSampler, but that’s how it works.
now we should add our code to both the .vsh and .fsh to make this work. In the firstProgram.fsh I’ve added the following code:
uniform sampler2D colorSampler;
varying vec2 uv;
void main()
{
vec4 color = texture2D(colorSampler, uv);
gl_FragColor = color;
}
This isn’t objective-c it’s c, and the colorSampler here is being piped in from the plist which SCNTechnique is using to tunnel data through. gl_fragColor is the final output to the fragment shader.
In the vsh we need to add in the following code:
attribute vec4 a_position;
varying vec2 uv;
void main(void)
{
uv = (a_position.xy + 1.0) * 0.5;
gl_Position = a_position;
}
The gl_Position is the final output for the vertices in the vertex shader. With these two parts of the firstProgram in place and the firstPass.plist setup we can now use it in the GameViewController.m
...
// configure the view
scnView.backgroundColor = [UIColor blackColor];
NSURL *url;
url = [[NSBundle mainBundle] URLForResource:@"firstPass" withExtension:@"plist"];
SCNTechnique *firstTechnique = [SCNTechnique techniqueWithDictionary:[NSDictionary dictionaryWithContentsOfURL:url]];
scnView.technique = firstTechnique;
...
In the template code we follow after the scnView is setup in the scene. Then we create a NSURL *url; to fill with url = [[NSBundle mainBundoe] URLForResource:@”firstPass” withExtension:@”plist”]; this makes a url that points to the firstPass.plist that we created with all of the data used to connect our shader program with the SCNTechnique. The we use SCNTechnique *firstTechnique to load in that dictionary. Finally we assign scnView.technique to the SCNTechnique we created from the plist.
IMG_0104
Horray, we’re drawing using a SCNTechnique, it doesn’t look like anything interesting is happening, but it’s really going through our shader program and not the usual scene.view. We can prove this by editing the shader program. We can draw the technique as red by changing the fsh to the following code.
uniform sampler2D colorSampler;
varying vec2 uv;
void main()
{
gl_FragColor = vec4(1.0, 0.0, 0.0, 0.0);
}
This sets the gl_fragColor to red. And now the iPad draws the image as all red. I’m still working on more interesting things to do with all of this but if you’re familiar with openGL then you’ll be able to do quite a lot. I’m not that familiar with openGL myself, so I’m learning what I can while I can. Hope this tutorial helps.
Read More
July 25, 2014
SceneKit shaderModifiers
So I started with the basic GameKit, this gives you a colorful jet object in the scene.
By default the code in the GameViewController.m looks like the following:
55

- (void)viewDidLoad
{
[super viewDidLoad];
// create a new scene
SCNScene *scene = [SCNScene sceneNamed:@"art.scnassets/ship.dae"];
// create and add a camera to the scene
SCNNode *cameraNode = [SCNNode node];
cameraNode.camera = [SCNCamera camera];
[scene.rootNode addChildNode:cameraNode];
// place the camera
cameraNode.position = SCNVector3Make(0, 0, 15);
// create and add a light to the scene
SCNNode *lightNode = [SCNNode node];
lightNode.light = [SCNLight light];
lightNode.light.type = SCNLightTypeOmni;
lightNode.position = SCNVector3Make(0, 10, 10);
[scene.rootNode addChildNode:lightNode];
// create and add an ambient light to the scene
SCNNode *ambientLightNode = [SCNNode node];
ambientLightNode.light = [SCNLight light];
ambientLightNode.light.type = SCNLightTypeAmbient;
ambientLightNode.light.color = [UIColor darkGrayColor];
[scene.rootNode addChildNode:ambientLightNode];
// retrieve the ship node
SCNNode *ship = [scene.rootNode childNodeWithName:@"ship" recursively:YES];
[ship runAction:[SCNAction repeatActionForever:[SCNAction rotateByX:0 y:0.2 z:0 duration:1]]];
// retrieve the SCNView
SCNView *scnView = (SCNView *)self.view;
// set the scene to the view
scnView.scene = scene;
// allows the user to manipulate the camera
scnView.allowsCameraControl = YES;
// show statistics such as fps and timing information
scnView.showsStatistics = YES;
// configure the view
scnView.backgroundColor = [UIColor blackColor];
// add a tap gesture recognizer
UITapGestureRecognizer *tapGesture = [[UITapGestureRecognizer alloc] initWithTarget:self action:@selector(handleTap:)];
NSMutableArray *gestureRecognizers = [NSMutableArray array];
[gestureRecognizers addObject:tapGesture];
[gestureRecognizers addObjectsFromArray:scnView.gestureRecognizers];
scnView.gestureRecognizers = gestureRecognizers;
}
There’s not much going on other than adding models, lights and cameras to the scene. I wanted to do some learning up on shaderModifiers so I started by getting the mesh in the ship.dae.
To do that I need to get to the material on the ship.
1
ship.geometry.firstMaterial
The above shows up with nothing, the ship included in the scene has no geometry in the ship node. This took a few minutes of fiddling before I found that the ship has a shipMesh child object.
Screen Shot 2014-07-25 at 6.48.44 PMThe child is called shipMesh, and that’s the node that would have a firstMaterial. To get to that I used
1
SCNNode *shipMesh = [ship childNodeWithName:@"shipMesh" recursively:YES];
The line assigns the actual mesh I need to get to the *shipMesh SCNNode object. now I can use the following:
1
SCNMaterial *mat = shipMesh.geometry.firstMaterial;
This assigns the shipMesh’s material to the SCNMaterial *mat so I can start adding shaderModifiers to the object in the scene.
Starting with the basics I tried out:
1
mat.shaderModifiers = @{SCNShaderModifierEntryPointFragment : @"_output.color.rgb = vec3(0.5);"};
this turned the ship to a grey color. on the iPad:
Screen Shot 2014-07-25 at 6.55.28 PMSo this was expected, vec3(0.5) tells GLSL to make a rgb color of r 0.5, g 0.5. b 0.5, it’s a handy short-hand for color making. Another thing I tried was the following.
1
mat.shaderModifiers = @{SCNShaderModifierEntryPointFragment : @"_output.color = vec4(0.5);"};
This wasn’t assigning color.rgb but color, which expects a vec4, and I got the same result; a grey jet appears on the iPad. Just to be thorough, I tried assigning an interesting value to the color.
1
mat.shaderModifiers = @{SCNShaderModifierEntryPointFragment : @"_output.color = vec4(0.5, 0.1, 0.2, 0.3);"};
The above turned into a reddish jet.
Screen Shot 2014-07-25 at 6.58.46 PM
So this again was expected. I took some code from the WWDC presentation and found some code to try out on the jet.
mat.shaderModifiers = @{SCNShaderModifierEntryPointGeometry : @"// Waves Modifier\n"
"float Amplitude = 1.2;\n"
"float Frequency = 5.0;\n"
"vec2 nrm = _geometry.position.xz;\n"
"float len = length(nrm)+0.0001; // for robustness\n"
"nrm /= len;\n"
"float a = len + Amplitude*sin(Frequency * _geometry.position.z + u_time * 10.0);\n"
"_geometry.position.xz = nrm * a;\n"};
The above made the jet all wobbly.
Screen Shot 2014-07-25 at 7.00.46 PMAll of the verts were going off of a sin(u_time) which is a value in the GLSL world that all shaders have access to. Cool stuff so far. After this I found some interesting car paint shader from the WWDC presentation and tweaked it to get the following result.
mat.shaderModifiers = @{SCNShaderModifierEntryPointSurface : @"\n"
"float flakeSize = sin(u_time * 0.2);\n"
"float flakeIntensity = 0.7;\n"
"vec3 paintColor0 = vec3(0.9, 0.4, 0.3);\n"
"vec3 paintColor1 = vec3(0.9, 0.75, 0.2);\n"
"vec3 flakeColor = vec3(flakeIntensity, flakeIntensity, flakeIntensity);\n"
"vec3 rnd = texture2D(u_diffuseTexture, _surface.diffuseTexcoord * vec2(1.0) * sin(u_time*0.1) ).rgb;\n"
"vec3 nrm1 = normalize(0.05 * rnd + 0.95 * _surface.normal);\n"
"vec3 nrm2 = normalize(0.3 * rnd + 0.4 * _surface.normal);\n"
"float fresnel1 = clamp(dot(nrm1, _surface.view), 0.0, 1.0);\n"
"float fresnel2 = clamp(dot(nrm2, _surface.view), 0.0, 1.0);\n"
"vec3 col = mix(paintColor0, paintColor1, fresnel1);\n"
"col += pow(fresnel2, 106.0) * flakeColor;\n"
"_surface.normal = nrm1;\n"
"_surface.diffuse = vec4(col.r,col.b,col.g, 1.0);\n"
"_surface.emission = (_surface.reflective * _surface.reflective) * 2.0;\n"
"_surface.reflective = vec4(0.0);\n"};
Screen Shot 2014-07-25 at 7.04.07 PMStrangely enough I didn’t delete the code that made the jet wobbly, so I’m guessing something was overwritten. The shaderModifiers is being assigned one value when we use = to assign the value an @{“”}; object. So a bit of looking at the shaderModifiers object in the materials and I see that it’s an NSDictionary. The NSMutableDictionary and NSDictionary are supposedly compatible, so I make a new NSMutableDictionary with the following:
1
NSMutableDictionary *shaders = [[NSMutableDictionary alloc]init];
I’ll use that and assign multiple keys with code to the *shaders dictionary.
this looks like the following:
NSMutableDictionary *shaders = [[NSMutableDictionary alloc]init];
shaders[SCNShaderModifierEntryPointGeometry] =
@"// Waves Modifier\n"
"float Amplitude = 1.2;\n"
"float Frequency = 5.0;\n"
"vec2 nrm = _geometry.position.xz;\n"
"float len = length(nrm)+0.0001; // for robustness\n"
"nrm /= len;\n"
"float a = len + Amplitude*sin(Frequency * _geometry.position.z + u_time * 10.0);\n"
"_geometry.position.xz = nrm * a;\n";
shaders[SCNShaderModifierEntryPointSurface] =
@"float flakeSize = sin(u_time * 0.2);\n"
"float flakeIntensity = 0.7;\n"
"vec3 paintColor0 = vec3(0.9, 0.4, 0.3);\n"
"vec3 paintColor1 = vec3(0.9, 0.75, 0.2);\n"
"vec3 flakeColor = vec3(flakeIntensity, flakeIntensity, flakeIntensity);\n"
"vec3 rnd = texture2D(u_diffuseTexture, _surface.diffuseTexcoord * vec2(1.0) * sin(u_time*0.1) ).rgb;\n"
"vec3 nrm1 = normalize(0.05 * rnd + 0.95 * _surface.normal);\n"
"vec3 nrm2 = normalize(0.3 * rnd + 0.4 * _surface.normal);\n"
"float fresnel1 = clamp(dot(nrm1, _surface.view), 0.0, 1.0);\n"
"float fresnel2 = clamp(dot(nrm2, _surface.view), 0.0, 1.0);\n"
"vec3 col = mix(paintColor0, paintColor1, fresnel1);\n"
"col += pow(fresnel2, 106.0) * flakeColor;\n"
"_surface.normal = nrm1;\n"
"_surface.diffuse = vec4(col.r,col.b,col.g, 1.0);\n"
"_surface.emission = (_surface.reflective * _surface.reflective) * 2.0;\n"
"_surface.reflective = vec4(0.0);\n";
mat.shaderModifiers = shaders;
The different SCNShaderModifierEntryPointGeometry and PointSurfaces are key values with objects assigned to them. At the end we assign mat.shaderModifiers = shaders to assign both of these objects in the NSMutableDictionary to the material. So now the final result looks like the following:
Screen Shot 2014-07-25 at 7.09.39 PM
A wobbly pink jet. The significance of all of this is that to apply multiple shaders to the object you need to create a dictionary first, and use the different entrypoint constant values as keys. Hope this all made sense.
Read More
June 18, 2014
Looking for some Unreal Stuff?
http://okita.com/alex/unreal-game-development-archive/
The archives and what’s been going on can be found on the link above. Updates and adventures will be forthcoming as well as a few project announcements.
IMG_20140610_083914Making the most of a small workshop means approaching a critical density of stuff. I need to organize this into something more sensible, and some cool gizmos will be coming to this site soon. Check back often!
发表评论
-
iOS与JS交互实战篇(ObjC版)
2016-05-04 10:42 544转载于: iOS开发技术分享 前言 ObjectiveC与J ... -
Objective-C与JavaScript交互的那些事
2016-05-04 10:44 503转载于:http://www.cocoachina.com/i ... -
Import Cheetah3D Model in SceneKit
2015-01-23 16:18 788http://blog.manbolo.com/2014/08 ... -
Scene Kit (翻译)
2015-01-23 10:35 655前言 http://segmentfault.com/ ... -
iOS 图形编程总结
2015-01-22 11:07 682iOS实现图形编程可以 ... -
Introduction to Scene Kit
2015-01-21 14:35 510Scene Kit Programming Guide[/b] ... -
使用scenekit的时候不能打开程序
2015-01-21 13:59 647问题一: nib上能加载class 程序却找不到,在使用sce ... -
报错: dyld: Library not loaded
2015-01-21 13:02 1046一、问题 dyld: Library not loaded: ... -
iOS Sprite Kit最新特性Physics Field虚拟物理场Swift测试
2015-01-19 16:30 593转载于:http://blog.csdn.ne ... -
Sprite Kit编程指南(1)-深入Sprite Kit
2015-01-19 15:53 659Sprite Kit编程指南(1)- ...
相关推荐
SCNTechnique是SceneKit中的一个重要概念,它允许我们自定义渲染管道,实现更高级的图形效果。本文将深入探讨SCNTechnique的简单实现及其在iOS开发中的应用。 首先,我们需要理解SCNTechnique是什么。SCNTechnique...
在这个特定的项目“scenekit-outline-shader-scntechnique”中,我们将关注如何在Xcode 9.3中利用`SCNTechnique`来实现一种特定的着色效果——轮廓描边。这个项目提供了一个简单的游乐场(Playground)示例,展示了...
`SCNTechnique`是SceneKit提供的一种机制,用于自定义渲染管道,它允许开发者利用Metal的强大功能来扩展SceneKit的功能。 在"SCNTechniqueTest"这个示例中,我们有两个关键的演示点: 1. **法线渲染为纹理**: 这...
技术测试SCN技术实验此类的文献资料非常丰富,没有任何示例。... 该项目探索SceneKit的SCNTechnique类及其各种可配置参数。 到目前为止,我已经能够创建以下技术高斯模糊与噪声戴着面具的夜视
内容概要:本文详细介绍了基于TMS320F系列芯片的C2000串口读写方案及其编程器——FlashPro2000的功能特点和支持的接口模式。文中不仅涵盖了硬件连接的具体步骤,还提供了代码实例来展示Flash擦除操作,并对比了JTAG和SCI-BOOT两种模式的优缺点。此外,针对不同型号的C2000系列芯片,给出了详细的适配指导以及避免烧录过程中可能出现的问题的方法。 适合人群:从事DSP开发的技术人员,尤其是对TI公司C2000系列芯片有一定了解并希望深入了解其编程和烧录细节的人群。 使用场景及目标:适用于实验室环境下的程序调试阶段,以及生产线上的批量烧录任务。主要目的是帮助开发者选择合适的编程工具和技术手段,提高工作效率,减少因误操作导致设备损坏的风险。 其他说明:文中提供的代码片段和命令行指令可以直接用于实际项目中,同时附带了一些实用技巧,如防止芯片变砖的小贴士和自动化重试脚本,有助于解决常见的烧录难题。
汉字字库存储芯片扩展实验 # 汉字字库存储芯片扩展实验 ## 实验目的 1. 了解汉字字库的存储原理和结构 2. 掌握存储芯片扩展技术 3. 学习如何通过硬件扩展实现大容量汉字字库存储 ## 实验原理 ### 汉字字库存储基础 - 汉字通常采用点阵方式存储(如16×16、24×24、32×32点阵) - 每个汉字需要占用32字节(16×16)到128字节(32×32)不等的存储空间 - 国标GB2312-80包含6763个汉字,需要较大存储容量 ### 存储芯片扩展方法 1. **位扩展**:增加数据总线宽度 2. **字扩展**:增加存储单元数量 3. **混合扩展**:同时进行位扩展和字扩展 ## 实验设备 - 单片机开发板(如STC89C52) - 存储芯片(如27C256、29C040等) - 逻辑门电路芯片(如74HC138、74HC373等) - 示波器、万用表等测试设备 - 连接线若干 ## 实验步骤 ### 1. 单芯片汉字存储实验 1. 连接27C256 EPROM芯片到单片机系统 2. 将16×16点阵汉字字库写入芯片 3. 编写程序读取并显示汉字 ### 2. 存储芯片字扩展实验 1. 使用地址译码器(如74HC138)扩展多片27C256 2. 将完整GB2312字库分布到各芯片中 3. 编写程序实现跨芯片汉字读取 ### 3. 存储芯片位扩展实验 1. 连接两片27C256实现16位数据总线扩展 2. 优化字库存储结构,提高读取速度 3. 测试并比较扩展前后的性能差异 ## 实验代码示例(单片机部分) ```c #include <reg52.h> #include <intrins.h> // 定义存储芯片控制引脚 sbit CE = P2^7; // 片选 sbit OE = P2^6; // 输出使能 sbit
测控装备干扰源快速侦测系统设计研究.pdf
嵌入式八股文面试题库资料知识宝典-【开发】嵌入式开源项目&库&资料.zip
嵌入式八股文面试题库资料知识宝典-百度2022年嵌入式面试题.zip
少儿编程scratch项目源代码文件案例素材-空间站.zip
基于关联规则的商业银行个性化产品推荐.pdf
嵌入式八股文面试题库资料知识宝典-Linux基础使用.zip
内容概要:本文详细介绍了利用MATLAB进行轴棱锥生成贝塞尔高斯光束及环形光束光强图像的仿真研究。首先阐述了实验的背景与目标,强调了MATLAB在光学和计算科学领域的广泛应用。接着,具体描述了实验的方法与步骤,包括材料准备、仿真过程中的参数设定和光束生成代码编写。最后,对实验结果进行了深入分析,展示了贝塞尔高斯光束和环形光束的光强分布特点,验证了其光学性能的预期表现。文章还对未来的研究方向和技术改进提出了展望。 适合人群:从事光学、物理学及相关领域研究的专业人士,特别是对光束生成和光学性能分析感兴趣的科研工作者。 使用场景及目标:适用于需要进行光束生成和性能分析的实验室环境,旨在帮助研究人员更好地理解和优化光束特性和传播行为。 其他说明:本文不仅提供了详细的实验方法和步骤,还附有丰富的实验结果和数据分析,为后续研究提供了宝贵的参考资料。
内容概要:本文探讨了三电平NPC型有源电力滤波器(APF)的模型预测控制(MPC)中存在的开关频率过高问题及其解决方案。传统MPC方法会导致极高的开关频率,增加了系统的能耗和热量。通过引入滞环控制模块,可以在不大幅牺牲性能的情况下有效降低开关频率。具体来说,滞环控制通过在价值函数计算后增加一个判断条件,对状态切换进行惩罚,从而减少不必要的开关动作。实验结果显示,开关频率从4392Hz降至3242Hz,降幅达26.2%,虽然电流总谐波畸变率(THD)略有上升,但仍符合国家标准。此外,文中还提出了动态调整滞环宽度的方法,以进一步优化不同负载条件下的表现。 适合人群:从事电力电子、电力系统控制领域的研究人员和技术人员,特别是关注APF和MPC技术的人群。 使用场景及目标:适用于需要优化APF系统开关频率的研究和工程项目,旨在提高系统效率并降低成本。目标是在不影响系统性能的前提下,显著降低开关频率,减少能量损失和热管理难度。 其他说明:文章不仅提供了理论分析,还包括具体的实现代码片段,有助于读者理解和实践。同时,强调了在实际应用中需要注意的问题,如中点电位漂移等。
内容概要:本文介绍了三维POD DMD程序在处理原网格数据方面的独特优势和技术细节。首先阐述了该程序能读取结构化和非结构化网格数据及其拓扑关系,在生成模态数据过程中保持原始网格形态而不需要进行网格插值操作。接着展示了简化版本的Python代码片段,揭示了读取网格数据和生成模态数据的核心逻辑。最后提到提供的辅助学习资料如代码、视频教程、Word教程和实例数据,帮助用户深入理解并掌握该程序的应用。 适合人群:从事计算流体力学领域的研究人员和技术爱好者,尤其是那些希望提高数据处理效率的人群。 使用场景及目标:适用于需要处理复杂网格数据的研究项目,旨在简化数据处理流程,提升工作效率,同时保持数据的原始特性。 其他说明:文中不仅提供了理论性的讲解,还有具体的代码示例和丰富的学习资源,使读者可以边学边练,快速上手。
融合双向路由注意力的多尺度X光违禁品检测.pdf
嵌入式八股文面试题库资料知识宝典-Linux_Shell基础使用.zip
嵌入式八股文面试题库资料知识宝典-联发科2021武汉嵌入式软件开发.zip
基于有限体积法Godunov格式的管道泄漏检测模型研究.pdf
嵌入式八股文面试题库资料知识宝典-ARM常见面试题目.zip