- 浏览: 26884 次
- 性别:
- 来自: 上海
-
文章分类
最新评论
转摘与:http://okita.com/alex/
SCNTechnique in SceneKit
New in ios8 is the SCNTechnique. It’s a way to get your models to pass through a custom shader program. This is an added layer on top of an objects filters. For instance, you’re able to apply a Gaussian blur to a single node in a SceneKit scene, then pass the scene to a fragment shader to change the color of the scene.
新的ios8 SCNTechnique技术。这是一种让你的模型通过一个自定义着色器程序。这是一个添加过滤器层上的一个对象。例如,你能够应用高斯模糊SceneKit现场单个节点,然后通过场景片段着色器改变现场的颜色。
Getting started I’m setting up a new ios game.
1、开始我设置一个新的ios游戏。
[img][/img]
This will create the scene view that SceneKit uses to render it’s 3d objects to. I’ve named the project SCNTechnique, this will make it obvious what this project is being used for.
2、这将创建SceneKit使用的场景视图呈现它的3 d对象。我将该项目命名为“SCNTechnique,这将使它明显被用于这一项目。
I’m also enabling the local source control, I think git is required for this to work. If you don’t have this then I suggest you use it. If you break something it’s useful to know what you changed.
3..
In the project we’ll want to set up a new dictionary that’s used to reference and define data going to and from the SCNTechnique rendering pass. I’m adding an iOS property list. Selecting add new file to the project to open this choose a template for your new file dialog:
4、项目中我们想要建立一个新的字典,用来引用和定义数据和从SCNTechnique呈现通过。我添加一个iOS属性列表。选择将新文件添加到项目中打开这个为你的新文件对话框:选择一个模板
Then I’m naming it firstPass, it’ll add the plist file extension for me. A property list is an XML file which Xcode allows us to edit with a more friendly interface.
5、然后我给它命名firstPass,它会增加我的plist文件扩展名。一个Xcode属性列表是一个XML文件允许我们编辑更友好的界面。
The file appears with Root as the only section of data. We need to populate this with a few things to turn it into something that can be used by SCNTechnique. There are three entries [sequence, passes, symbols] where sequence is an Array and passes and symbols are both Dictionaries. These are added with the plus icon, and the type is changed with a popup menu under the type column.
6、文件只出现与根部分的数据。我们需要填充这几件事,把它变成SCNTechnique可以使用的东西。有三个条目(序列,通过符号),序列是一个数组,通过和符号都是字典。这些添加的加号图标,弹出菜单的类型是改变类型列。
sequence defines what pass is rendered when. To be honest, I think this means that you can define multiple passes in a single SCNTechnique, but so far this seems to be quite buggy and I can’t seem to get more than one pass working. Passes defines what parameters are passed to and from the shader programs. We’ll get to shader programs in a moment. symbols defines what name and type the data is passed from your code into the shaders.
7、序列定义了通过时呈现。老实说,我认为,这意味着您可以定义多个传入一个SCNTechnique,但到目前为止,这似乎是相当车,我似乎无法得到不止一个传递工作。通过定义了参数传递的着色器程序。我们会着色器程序。符号定义了名称和类型的数据从您的代码传递到着色器。
So shader programs, I couldn’t find any appropriate templates to start with for these, so I ended up picking iOS/Other/Empty template. Which isn’t much of a template… But it is necessary to ensure that the project is aware of your new file. I added two files, a firstProgram.vsh and a firstProgram.fsh.
8、所以着色器程序,我找不到任何合适的模板,从这些开始,所以我最终选择iOS /其他/空模板。这并不是很大的模板…但它是必要的,以确保该项目是意识到自己的新文件。我添加了两个文件,一个firstProgram。太小,firstProgram.fsh。
These live in the project like so.
What is the fsh and vsh for? the fsh means fragment shader and the vsh means vertex shader. Basically these are common OpenGL type shader programs. To make the connection between these shader programs and SCNTechnique in your SceneKit scene you’ll need to add them to the firstPass.plist so back to defining the technique’s property list.
9、fsh和vsh是什么?fsh意味着片段着色器和太小意味着顶点着色器。基本上这些都是常见的OpenGL渲染程序类型。这些着色器程序之间的联系和SCNTechnique SceneKit场景你需要将它们添加到firstPass。plist所以回定义技术的属性列表。
In the Sequence array we need to name a rendering pass in the passes list. This seems to be the entry point for the technique. I’m naming it renderingPass.
10、序列数组中我们需要呈现通过通过列表中的名称。这似乎是入口点的技术。我命名它renderingPass。
This tells the Technique where to start. The item 0 of the sequence needs to point to an entry in the passes item. Then in passes we are require to have 4 entries.
11、这告诉技术从哪里开始。0项的序列需要指向一个条目的条目。然后在通过我们需要有4个条目。
draw program inputs and outputs, draw is a string program is another string and inputs and outputs are both dictionaries.
12、画程序输入和输出,平局是一个字符串的程序是另一个字符串,输入和输出都是字典。
draw needs to be set to DRAW_QUAD which is used to draw data piped into the shader program, we also have DRAW_NODE or DRAW_SCENE. Each is used for specific reasons, but for now we’ll use DRAW_QUAD. The program refers to the .vsh and .fsh files we created and added to the project a moment ago. (note: the case and underscore are important) Don’t add the .vsh or .fsh to the program, Technique knows what to do with the name. I’ll always look for both files, if one or the other are missing the Technique will fail and your app will stop when looking for the program.
13、将需要设置DRAW_QUAD用于将数据输送到着色器程序,我们也有DRAW_NODE或DRAW_SCENE。每个用于特定的原因,但现在我们将使用DRAW_QUAD。程序指的是。太小。fsh文件创建和添加到项目中。(注:和下划线)很重要不要添加。太小。fsh的项目,技术知道如何处理这个名字。我总是会找两个文件,如果一个或另一个缺少技术会失败,应用程序会停止当寻找项目。
It seems rather necessary that one of the inputs is COLOR which goes into a colorSampler. COLOR is an openGL data source and colorSampler will be available in the shader program with data coming from COLOR. the a_position is a variable which points to a_position-symbol. We will need to add this to the symbols section of the technique’s plist. So we’ll add that in next.
14、似乎而必要的输入是进了colorSampler颜色。颜色是一个openGL数据源和colorSampler将着色器程序中可用的数据来自颜色。a_position是一个变量,指向a_position-symbol。我们将需要添加这个符号部分技术的plist。所以接下来我们将添加进去。
In the a_position we add a_position-symbol and in symbols create a_position-symbol as a dictionary and add semantic vertex string to create a link between your SCNTechnique and the program. I’m not exactly sure why we don’t need to do this for colorSampler, but that’s how it works.
now we should add our code to both the .vsh and .fsh to make this work. In the firstProgram.fsh I’ve added the following code:
uniform sampler2D colorSampler;
varying vec2 uv;
void main()
{
vec4 color = texture2D(colorSampler, uv);
gl_FragColor = color;
}
This isn’t objective-c it’s c, and the colorSampler here is being piped in from the plist which SCNTechnique is using to tunnel data through. gl_fragColor is the final output to the fragment shader.
In the vsh we need to add in the following code:
attribute vec4 a_position;
varying vec2 uv;
void main(void)
{
uv = (a_position.xy + 1.0) * 0.5;
gl_Position = a_position;
}
The gl_Position is the final output for the vertices in the vertex shader. With these two parts of the firstProgram in place and the firstPass.plist setup we can now use it in the GameViewController.m
...
// configure the view
scnView.backgroundColor = [UIColor blackColor];
NSURL *url;
url = [[NSBundle mainBundle] URLForResource:@"firstPass" withExtension:@"plist"];
SCNTechnique *firstTechnique = [SCNTechnique techniqueWithDictionary:[NSDictionary dictionaryWithContentsOfURL:url]];
scnView.technique = firstTechnique;
...
In the template code we follow after the scnView is setup in the scene. Then we create a NSURL *url; to fill with url = [[NSBundle mainBundoe] URLForResource:@”firstPass” withExtension:@”plist”]; this makes a url that points to the firstPass.plist that we created with all of the data used to connect our shader program with the SCNTechnique. The we use SCNTechnique *firstTechnique to load in that dictionary. Finally we assign scnView.technique to the SCNTechnique we created from the plist.
IMG_0104
Horray, we’re drawing using a SCNTechnique, it doesn’t look like anything interesting is happening, but it’s really going through our shader program and not the usual scene.view. We can prove this by editing the shader program. We can draw the technique as red by changing the fsh to the following code.
uniform sampler2D colorSampler;
varying vec2 uv;
void main()
{
gl_FragColor = vec4(1.0, 0.0, 0.0, 0.0);
}
This sets the gl_fragColor to red. And now the iPad draws the image as all red. I’m still working on more interesting things to do with all of this but if you’re familiar with openGL then you’ll be able to do quite a lot. I’m not that familiar with openGL myself, so I’m learning what I can while I can. Hope this tutorial helps.
Read More
July 25, 2014
SceneKit shaderModifiers
So I started with the basic GameKit, this gives you a colorful jet object in the scene.
By default the code in the GameViewController.m looks like the following:
55
- (void)viewDidLoad
{
[super viewDidLoad];
// create a new scene
SCNScene *scene = [SCNScene sceneNamed:@"art.scnassets/ship.dae"];
// create and add a camera to the scene
SCNNode *cameraNode = [SCNNode node];
cameraNode.camera = [SCNCamera camera];
[scene.rootNode addChildNode:cameraNode];
// place the camera
cameraNode.position = SCNVector3Make(0, 0, 15);
// create and add a light to the scene
SCNNode *lightNode = [SCNNode node];
lightNode.light = [SCNLight light];
lightNode.light.type = SCNLightTypeOmni;
lightNode.position = SCNVector3Make(0, 10, 10);
[scene.rootNode addChildNode:lightNode];
// create and add an ambient light to the scene
SCNNode *ambientLightNode = [SCNNode node];
ambientLightNode.light = [SCNLight light];
ambientLightNode.light.type = SCNLightTypeAmbient;
ambientLightNode.light.color = [UIColor darkGrayColor];
[scene.rootNode addChildNode:ambientLightNode];
// retrieve the ship node
SCNNode *ship = [scene.rootNode childNodeWithName:@"ship" recursively:YES];
[ship runAction:[SCNAction repeatActionForever:[SCNAction rotateByX:0 y:0.2 z:0 duration:1]]];
// retrieve the SCNView
SCNView *scnView = (SCNView *)self.view;
// set the scene to the view
scnView.scene = scene;
// allows the user to manipulate the camera
scnView.allowsCameraControl = YES;
// show statistics such as fps and timing information
scnView.showsStatistics = YES;
// configure the view
scnView.backgroundColor = [UIColor blackColor];
// add a tap gesture recognizer
UITapGestureRecognizer *tapGesture = [[UITapGestureRecognizer alloc] initWithTarget:self action:@selector(handleTap:)];
NSMutableArray *gestureRecognizers = [NSMutableArray array];
[gestureRecognizers addObject:tapGesture];
[gestureRecognizers addObjectsFromArray:scnView.gestureRecognizers];
scnView.gestureRecognizers = gestureRecognizers;
}
There’s not much going on other than adding models, lights and cameras to the scene. I wanted to do some learning up on shaderModifiers so I started by getting the mesh in the ship.dae.
To do that I need to get to the material on the ship.
1
ship.geometry.firstMaterial
The above shows up with nothing, the ship included in the scene has no geometry in the ship node. This took a few minutes of fiddling before I found that the ship has a shipMesh child object.
Screen Shot 2014-07-25 at 6.48.44 PMThe child is called shipMesh, and that’s the node that would have a firstMaterial. To get to that I used
1
SCNNode *shipMesh = [ship childNodeWithName:@"shipMesh" recursively:YES];
The line assigns the actual mesh I need to get to the *shipMesh SCNNode object. now I can use the following:
1
SCNMaterial *mat = shipMesh.geometry.firstMaterial;
This assigns the shipMesh’s material to the SCNMaterial *mat so I can start adding shaderModifiers to the object in the scene.
Starting with the basics I tried out:
1
mat.shaderModifiers = @{SCNShaderModifierEntryPointFragment : @"_output.color.rgb = vec3(0.5);"};
this turned the ship to a grey color. on the iPad:
Screen Shot 2014-07-25 at 6.55.28 PMSo this was expected, vec3(0.5) tells GLSL to make a rgb color of r 0.5, g 0.5. b 0.5, it’s a handy short-hand for color making. Another thing I tried was the following.
1
mat.shaderModifiers = @{SCNShaderModifierEntryPointFragment : @"_output.color = vec4(0.5);"};
This wasn’t assigning color.rgb but color, which expects a vec4, and I got the same result; a grey jet appears on the iPad. Just to be thorough, I tried assigning an interesting value to the color.
1
mat.shaderModifiers = @{SCNShaderModifierEntryPointFragment : @"_output.color = vec4(0.5, 0.1, 0.2, 0.3);"};
The above turned into a reddish jet.
Screen Shot 2014-07-25 at 6.58.46 PM
So this again was expected. I took some code from the WWDC presentation and found some code to try out on the jet.
mat.shaderModifiers = @{SCNShaderModifierEntryPointGeometry : @"// Waves Modifier\n"
"float Amplitude = 1.2;\n"
"float Frequency = 5.0;\n"
"vec2 nrm = _geometry.position.xz;\n"
"float len = length(nrm)+0.0001; // for robustness\n"
"nrm /= len;\n"
"float a = len + Amplitude*sin(Frequency * _geometry.position.z + u_time * 10.0);\n"
"_geometry.position.xz = nrm * a;\n"};
The above made the jet all wobbly.
Screen Shot 2014-07-25 at 7.00.46 PMAll of the verts were going off of a sin(u_time) which is a value in the GLSL world that all shaders have access to. Cool stuff so far. After this I found some interesting car paint shader from the WWDC presentation and tweaked it to get the following result.
mat.shaderModifiers = @{SCNShaderModifierEntryPointSurface : @"\n"
"float flakeSize = sin(u_time * 0.2);\n"
"float flakeIntensity = 0.7;\n"
"vec3 paintColor0 = vec3(0.9, 0.4, 0.3);\n"
"vec3 paintColor1 = vec3(0.9, 0.75, 0.2);\n"
"vec3 flakeColor = vec3(flakeIntensity, flakeIntensity, flakeIntensity);\n"
"vec3 rnd = texture2D(u_diffuseTexture, _surface.diffuseTexcoord * vec2(1.0) * sin(u_time*0.1) ).rgb;\n"
"vec3 nrm1 = normalize(0.05 * rnd + 0.95 * _surface.normal);\n"
"vec3 nrm2 = normalize(0.3 * rnd + 0.4 * _surface.normal);\n"
"float fresnel1 = clamp(dot(nrm1, _surface.view), 0.0, 1.0);\n"
"float fresnel2 = clamp(dot(nrm2, _surface.view), 0.0, 1.0);\n"
"vec3 col = mix(paintColor0, paintColor1, fresnel1);\n"
"col += pow(fresnel2, 106.0) * flakeColor;\n"
"_surface.normal = nrm1;\n"
"_surface.diffuse = vec4(col.r,col.b,col.g, 1.0);\n"
"_surface.emission = (_surface.reflective * _surface.reflective) * 2.0;\n"
"_surface.reflective = vec4(0.0);\n"};
Screen Shot 2014-07-25 at 7.04.07 PMStrangely enough I didn’t delete the code that made the jet wobbly, so I’m guessing something was overwritten. The shaderModifiers is being assigned one value when we use = to assign the value an @{“”}; object. So a bit of looking at the shaderModifiers object in the materials and I see that it’s an NSDictionary. The NSMutableDictionary and NSDictionary are supposedly compatible, so I make a new NSMutableDictionary with the following:
1
NSMutableDictionary *shaders = [[NSMutableDictionary alloc]init];
I’ll use that and assign multiple keys with code to the *shaders dictionary.
this looks like the following:
NSMutableDictionary *shaders = [[NSMutableDictionary alloc]init];
shaders[SCNShaderModifierEntryPointGeometry] =
@"// Waves Modifier\n"
"float Amplitude = 1.2;\n"
"float Frequency = 5.0;\n"
"vec2 nrm = _geometry.position.xz;\n"
"float len = length(nrm)+0.0001; // for robustness\n"
"nrm /= len;\n"
"float a = len + Amplitude*sin(Frequency * _geometry.position.z + u_time * 10.0);\n"
"_geometry.position.xz = nrm * a;\n";
shaders[SCNShaderModifierEntryPointSurface] =
@"float flakeSize = sin(u_time * 0.2);\n"
"float flakeIntensity = 0.7;\n"
"vec3 paintColor0 = vec3(0.9, 0.4, 0.3);\n"
"vec3 paintColor1 = vec3(0.9, 0.75, 0.2);\n"
"vec3 flakeColor = vec3(flakeIntensity, flakeIntensity, flakeIntensity);\n"
"vec3 rnd = texture2D(u_diffuseTexture, _surface.diffuseTexcoord * vec2(1.0) * sin(u_time*0.1) ).rgb;\n"
"vec3 nrm1 = normalize(0.05 * rnd + 0.95 * _surface.normal);\n"
"vec3 nrm2 = normalize(0.3 * rnd + 0.4 * _surface.normal);\n"
"float fresnel1 = clamp(dot(nrm1, _surface.view), 0.0, 1.0);\n"
"float fresnel2 = clamp(dot(nrm2, _surface.view), 0.0, 1.0);\n"
"vec3 col = mix(paintColor0, paintColor1, fresnel1);\n"
"col += pow(fresnel2, 106.0) * flakeColor;\n"
"_surface.normal = nrm1;\n"
"_surface.diffuse = vec4(col.r,col.b,col.g, 1.0);\n"
"_surface.emission = (_surface.reflective * _surface.reflective) * 2.0;\n"
"_surface.reflective = vec4(0.0);\n";
mat.shaderModifiers = shaders;
The different SCNShaderModifierEntryPointGeometry and PointSurfaces are key values with objects assigned to them. At the end we assign mat.shaderModifiers = shaders to assign both of these objects in the NSMutableDictionary to the material. So now the final result looks like the following:
Screen Shot 2014-07-25 at 7.09.39 PM
A wobbly pink jet. The significance of all of this is that to apply multiple shaders to the object you need to create a dictionary first, and use the different entrypoint constant values as keys. Hope this all made sense.
Read More
June 18, 2014
Looking for some Unreal Stuff?
http://okita.com/alex/unreal-game-development-archive/
The archives and what’s been going on can be found on the link above. Updates and adventures will be forthcoming as well as a few project announcements.
IMG_20140610_083914Making the most of a small workshop means approaching a critical density of stuff. I need to organize this into something more sensible, and some cool gizmos will be coming to this site soon. Check back often!
SCNTechnique in SceneKit
New in ios8 is the SCNTechnique. It’s a way to get your models to pass through a custom shader program. This is an added layer on top of an objects filters. For instance, you’re able to apply a Gaussian blur to a single node in a SceneKit scene, then pass the scene to a fragment shader to change the color of the scene.
新的ios8 SCNTechnique技术。这是一种让你的模型通过一个自定义着色器程序。这是一个添加过滤器层上的一个对象。例如,你能够应用高斯模糊SceneKit现场单个节点,然后通过场景片段着色器改变现场的颜色。
Getting started I’m setting up a new ios game.
1、开始我设置一个新的ios游戏。
[img][/img]
This will create the scene view that SceneKit uses to render it’s 3d objects to. I’ve named the project SCNTechnique, this will make it obvious what this project is being used for.
2、这将创建SceneKit使用的场景视图呈现它的3 d对象。我将该项目命名为“SCNTechnique,这将使它明显被用于这一项目。
I’m also enabling the local source control, I think git is required for this to work. If you don’t have this then I suggest you use it. If you break something it’s useful to know what you changed.
3..
In the project we’ll want to set up a new dictionary that’s used to reference and define data going to and from the SCNTechnique rendering pass. I’m adding an iOS property list. Selecting add new file to the project to open this choose a template for your new file dialog:
4、项目中我们想要建立一个新的字典,用来引用和定义数据和从SCNTechnique呈现通过。我添加一个iOS属性列表。选择将新文件添加到项目中打开这个为你的新文件对话框:选择一个模板
Then I’m naming it firstPass, it’ll add the plist file extension for me. A property list is an XML file which Xcode allows us to edit with a more friendly interface.
5、然后我给它命名firstPass,它会增加我的plist文件扩展名。一个Xcode属性列表是一个XML文件允许我们编辑更友好的界面。
The file appears with Root as the only section of data. We need to populate this with a few things to turn it into something that can be used by SCNTechnique. There are three entries [sequence, passes, symbols] where sequence is an Array and passes and symbols are both Dictionaries. These are added with the plus icon, and the type is changed with a popup menu under the type column.
6、文件只出现与根部分的数据。我们需要填充这几件事,把它变成SCNTechnique可以使用的东西。有三个条目(序列,通过符号),序列是一个数组,通过和符号都是字典。这些添加的加号图标,弹出菜单的类型是改变类型列。
sequence defines what pass is rendered when. To be honest, I think this means that you can define multiple passes in a single SCNTechnique, but so far this seems to be quite buggy and I can’t seem to get more than one pass working. Passes defines what parameters are passed to and from the shader programs. We’ll get to shader programs in a moment. symbols defines what name and type the data is passed from your code into the shaders.
7、序列定义了通过时呈现。老实说,我认为,这意味着您可以定义多个传入一个SCNTechnique,但到目前为止,这似乎是相当车,我似乎无法得到不止一个传递工作。通过定义了参数传递的着色器程序。我们会着色器程序。符号定义了名称和类型的数据从您的代码传递到着色器。
So shader programs, I couldn’t find any appropriate templates to start with for these, so I ended up picking iOS/Other/Empty template. Which isn’t much of a template… But it is necessary to ensure that the project is aware of your new file. I added two files, a firstProgram.vsh and a firstProgram.fsh.
8、所以着色器程序,我找不到任何合适的模板,从这些开始,所以我最终选择iOS /其他/空模板。这并不是很大的模板…但它是必要的,以确保该项目是意识到自己的新文件。我添加了两个文件,一个firstProgram。太小,firstProgram.fsh。
These live in the project like so.
What is the fsh and vsh for? the fsh means fragment shader and the vsh means vertex shader. Basically these are common OpenGL type shader programs. To make the connection between these shader programs and SCNTechnique in your SceneKit scene you’ll need to add them to the firstPass.plist so back to defining the technique’s property list.
9、fsh和vsh是什么?fsh意味着片段着色器和太小意味着顶点着色器。基本上这些都是常见的OpenGL渲染程序类型。这些着色器程序之间的联系和SCNTechnique SceneKit场景你需要将它们添加到firstPass。plist所以回定义技术的属性列表。
In the Sequence array we need to name a rendering pass in the passes list. This seems to be the entry point for the technique. I’m naming it renderingPass.
10、序列数组中我们需要呈现通过通过列表中的名称。这似乎是入口点的技术。我命名它renderingPass。
This tells the Technique where to start. The item 0 of the sequence needs to point to an entry in the passes item. Then in passes we are require to have 4 entries.
11、这告诉技术从哪里开始。0项的序列需要指向一个条目的条目。然后在通过我们需要有4个条目。
draw program inputs and outputs, draw is a string program is another string and inputs and outputs are both dictionaries.
12、画程序输入和输出,平局是一个字符串的程序是另一个字符串,输入和输出都是字典。
draw needs to be set to DRAW_QUAD which is used to draw data piped into the shader program, we also have DRAW_NODE or DRAW_SCENE. Each is used for specific reasons, but for now we’ll use DRAW_QUAD. The program refers to the .vsh and .fsh files we created and added to the project a moment ago. (note: the case and underscore are important) Don’t add the .vsh or .fsh to the program, Technique knows what to do with the name. I’ll always look for both files, if one or the other are missing the Technique will fail and your app will stop when looking for the program.
13、将需要设置DRAW_QUAD用于将数据输送到着色器程序,我们也有DRAW_NODE或DRAW_SCENE。每个用于特定的原因,但现在我们将使用DRAW_QUAD。程序指的是。太小。fsh文件创建和添加到项目中。(注:和下划线)很重要不要添加。太小。fsh的项目,技术知道如何处理这个名字。我总是会找两个文件,如果一个或另一个缺少技术会失败,应用程序会停止当寻找项目。
It seems rather necessary that one of the inputs is COLOR which goes into a colorSampler. COLOR is an openGL data source and colorSampler will be available in the shader program with data coming from COLOR. the a_position is a variable which points to a_position-symbol. We will need to add this to the symbols section of the technique’s plist. So we’ll add that in next.
14、似乎而必要的输入是进了colorSampler颜色。颜色是一个openGL数据源和colorSampler将着色器程序中可用的数据来自颜色。a_position是一个变量,指向a_position-symbol。我们将需要添加这个符号部分技术的plist。所以接下来我们将添加进去。
In the a_position we add a_position-symbol and in symbols create a_position-symbol as a dictionary and add semantic vertex string to create a link between your SCNTechnique and the program. I’m not exactly sure why we don’t need to do this for colorSampler, but that’s how it works.
now we should add our code to both the .vsh and .fsh to make this work. In the firstProgram.fsh I’ve added the following code:
uniform sampler2D colorSampler;
varying vec2 uv;
void main()
{
vec4 color = texture2D(colorSampler, uv);
gl_FragColor = color;
}
This isn’t objective-c it’s c, and the colorSampler here is being piped in from the plist which SCNTechnique is using to tunnel data through. gl_fragColor is the final output to the fragment shader.
In the vsh we need to add in the following code:
attribute vec4 a_position;
varying vec2 uv;
void main(void)
{
uv = (a_position.xy + 1.0) * 0.5;
gl_Position = a_position;
}
The gl_Position is the final output for the vertices in the vertex shader. With these two parts of the firstProgram in place and the firstPass.plist setup we can now use it in the GameViewController.m
...
// configure the view
scnView.backgroundColor = [UIColor blackColor];
NSURL *url;
url = [[NSBundle mainBundle] URLForResource:@"firstPass" withExtension:@"plist"];
SCNTechnique *firstTechnique = [SCNTechnique techniqueWithDictionary:[NSDictionary dictionaryWithContentsOfURL:url]];
scnView.technique = firstTechnique;
...
In the template code we follow after the scnView is setup in the scene. Then we create a NSURL *url; to fill with url = [[NSBundle mainBundoe] URLForResource:@”firstPass” withExtension:@”plist”]; this makes a url that points to the firstPass.plist that we created with all of the data used to connect our shader program with the SCNTechnique. The we use SCNTechnique *firstTechnique to load in that dictionary. Finally we assign scnView.technique to the SCNTechnique we created from the plist.
IMG_0104
Horray, we’re drawing using a SCNTechnique, it doesn’t look like anything interesting is happening, but it’s really going through our shader program and not the usual scene.view. We can prove this by editing the shader program. We can draw the technique as red by changing the fsh to the following code.
uniform sampler2D colorSampler;
varying vec2 uv;
void main()
{
gl_FragColor = vec4(1.0, 0.0, 0.0, 0.0);
}
This sets the gl_fragColor to red. And now the iPad draws the image as all red. I’m still working on more interesting things to do with all of this but if you’re familiar with openGL then you’ll be able to do quite a lot. I’m not that familiar with openGL myself, so I’m learning what I can while I can. Hope this tutorial helps.
Read More
July 25, 2014
SceneKit shaderModifiers
So I started with the basic GameKit, this gives you a colorful jet object in the scene.
By default the code in the GameViewController.m looks like the following:
55

- (void)viewDidLoad
{
[super viewDidLoad];
// create a new scene
SCNScene *scene = [SCNScene sceneNamed:@"art.scnassets/ship.dae"];
// create and add a camera to the scene
SCNNode *cameraNode = [SCNNode node];
cameraNode.camera = [SCNCamera camera];
[scene.rootNode addChildNode:cameraNode];
// place the camera
cameraNode.position = SCNVector3Make(0, 0, 15);
// create and add a light to the scene
SCNNode *lightNode = [SCNNode node];
lightNode.light = [SCNLight light];
lightNode.light.type = SCNLightTypeOmni;
lightNode.position = SCNVector3Make(0, 10, 10);
[scene.rootNode addChildNode:lightNode];
// create and add an ambient light to the scene
SCNNode *ambientLightNode = [SCNNode node];
ambientLightNode.light = [SCNLight light];
ambientLightNode.light.type = SCNLightTypeAmbient;
ambientLightNode.light.color = [UIColor darkGrayColor];
[scene.rootNode addChildNode:ambientLightNode];
// retrieve the ship node
SCNNode *ship = [scene.rootNode childNodeWithName:@"ship" recursively:YES];
[ship runAction:[SCNAction repeatActionForever:[SCNAction rotateByX:0 y:0.2 z:0 duration:1]]];
// retrieve the SCNView
SCNView *scnView = (SCNView *)self.view;
// set the scene to the view
scnView.scene = scene;
// allows the user to manipulate the camera
scnView.allowsCameraControl = YES;
// show statistics such as fps and timing information
scnView.showsStatistics = YES;
// configure the view
scnView.backgroundColor = [UIColor blackColor];
// add a tap gesture recognizer
UITapGestureRecognizer *tapGesture = [[UITapGestureRecognizer alloc] initWithTarget:self action:@selector(handleTap:)];
NSMutableArray *gestureRecognizers = [NSMutableArray array];
[gestureRecognizers addObject:tapGesture];
[gestureRecognizers addObjectsFromArray:scnView.gestureRecognizers];
scnView.gestureRecognizers = gestureRecognizers;
}
There’s not much going on other than adding models, lights and cameras to the scene. I wanted to do some learning up on shaderModifiers so I started by getting the mesh in the ship.dae.
To do that I need to get to the material on the ship.
1
ship.geometry.firstMaterial
The above shows up with nothing, the ship included in the scene has no geometry in the ship node. This took a few minutes of fiddling before I found that the ship has a shipMesh child object.
Screen Shot 2014-07-25 at 6.48.44 PMThe child is called shipMesh, and that’s the node that would have a firstMaterial. To get to that I used
1
SCNNode *shipMesh = [ship childNodeWithName:@"shipMesh" recursively:YES];
The line assigns the actual mesh I need to get to the *shipMesh SCNNode object. now I can use the following:
1
SCNMaterial *mat = shipMesh.geometry.firstMaterial;
This assigns the shipMesh’s material to the SCNMaterial *mat so I can start adding shaderModifiers to the object in the scene.
Starting with the basics I tried out:
1
mat.shaderModifiers = @{SCNShaderModifierEntryPointFragment : @"_output.color.rgb = vec3(0.5);"};
this turned the ship to a grey color. on the iPad:
Screen Shot 2014-07-25 at 6.55.28 PMSo this was expected, vec3(0.5) tells GLSL to make a rgb color of r 0.5, g 0.5. b 0.5, it’s a handy short-hand for color making. Another thing I tried was the following.
1
mat.shaderModifiers = @{SCNShaderModifierEntryPointFragment : @"_output.color = vec4(0.5);"};
This wasn’t assigning color.rgb but color, which expects a vec4, and I got the same result; a grey jet appears on the iPad. Just to be thorough, I tried assigning an interesting value to the color.
1
mat.shaderModifiers = @{SCNShaderModifierEntryPointFragment : @"_output.color = vec4(0.5, 0.1, 0.2, 0.3);"};
The above turned into a reddish jet.
Screen Shot 2014-07-25 at 6.58.46 PM
So this again was expected. I took some code from the WWDC presentation and found some code to try out on the jet.
mat.shaderModifiers = @{SCNShaderModifierEntryPointGeometry : @"// Waves Modifier\n"
"float Amplitude = 1.2;\n"
"float Frequency = 5.0;\n"
"vec2 nrm = _geometry.position.xz;\n"
"float len = length(nrm)+0.0001; // for robustness\n"
"nrm /= len;\n"
"float a = len + Amplitude*sin(Frequency * _geometry.position.z + u_time * 10.0);\n"
"_geometry.position.xz = nrm * a;\n"};
The above made the jet all wobbly.
Screen Shot 2014-07-25 at 7.00.46 PMAll of the verts were going off of a sin(u_time) which is a value in the GLSL world that all shaders have access to. Cool stuff so far. After this I found some interesting car paint shader from the WWDC presentation and tweaked it to get the following result.
mat.shaderModifiers = @{SCNShaderModifierEntryPointSurface : @"\n"
"float flakeSize = sin(u_time * 0.2);\n"
"float flakeIntensity = 0.7;\n"
"vec3 paintColor0 = vec3(0.9, 0.4, 0.3);\n"
"vec3 paintColor1 = vec3(0.9, 0.75, 0.2);\n"
"vec3 flakeColor = vec3(flakeIntensity, flakeIntensity, flakeIntensity);\n"
"vec3 rnd = texture2D(u_diffuseTexture, _surface.diffuseTexcoord * vec2(1.0) * sin(u_time*0.1) ).rgb;\n"
"vec3 nrm1 = normalize(0.05 * rnd + 0.95 * _surface.normal);\n"
"vec3 nrm2 = normalize(0.3 * rnd + 0.4 * _surface.normal);\n"
"float fresnel1 = clamp(dot(nrm1, _surface.view), 0.0, 1.0);\n"
"float fresnel2 = clamp(dot(nrm2, _surface.view), 0.0, 1.0);\n"
"vec3 col = mix(paintColor0, paintColor1, fresnel1);\n"
"col += pow(fresnel2, 106.0) * flakeColor;\n"
"_surface.normal = nrm1;\n"
"_surface.diffuse = vec4(col.r,col.b,col.g, 1.0);\n"
"_surface.emission = (_surface.reflective * _surface.reflective) * 2.0;\n"
"_surface.reflective = vec4(0.0);\n"};
Screen Shot 2014-07-25 at 7.04.07 PMStrangely enough I didn’t delete the code that made the jet wobbly, so I’m guessing something was overwritten. The shaderModifiers is being assigned one value when we use = to assign the value an @{“”}; object. So a bit of looking at the shaderModifiers object in the materials and I see that it’s an NSDictionary. The NSMutableDictionary and NSDictionary are supposedly compatible, so I make a new NSMutableDictionary with the following:
1
NSMutableDictionary *shaders = [[NSMutableDictionary alloc]init];
I’ll use that and assign multiple keys with code to the *shaders dictionary.
this looks like the following:
NSMutableDictionary *shaders = [[NSMutableDictionary alloc]init];
shaders[SCNShaderModifierEntryPointGeometry] =
@"// Waves Modifier\n"
"float Amplitude = 1.2;\n"
"float Frequency = 5.0;\n"
"vec2 nrm = _geometry.position.xz;\n"
"float len = length(nrm)+0.0001; // for robustness\n"
"nrm /= len;\n"
"float a = len + Amplitude*sin(Frequency * _geometry.position.z + u_time * 10.0);\n"
"_geometry.position.xz = nrm * a;\n";
shaders[SCNShaderModifierEntryPointSurface] =
@"float flakeSize = sin(u_time * 0.2);\n"
"float flakeIntensity = 0.7;\n"
"vec3 paintColor0 = vec3(0.9, 0.4, 0.3);\n"
"vec3 paintColor1 = vec3(0.9, 0.75, 0.2);\n"
"vec3 flakeColor = vec3(flakeIntensity, flakeIntensity, flakeIntensity);\n"
"vec3 rnd = texture2D(u_diffuseTexture, _surface.diffuseTexcoord * vec2(1.0) * sin(u_time*0.1) ).rgb;\n"
"vec3 nrm1 = normalize(0.05 * rnd + 0.95 * _surface.normal);\n"
"vec3 nrm2 = normalize(0.3 * rnd + 0.4 * _surface.normal);\n"
"float fresnel1 = clamp(dot(nrm1, _surface.view), 0.0, 1.0);\n"
"float fresnel2 = clamp(dot(nrm2, _surface.view), 0.0, 1.0);\n"
"vec3 col = mix(paintColor0, paintColor1, fresnel1);\n"
"col += pow(fresnel2, 106.0) * flakeColor;\n"
"_surface.normal = nrm1;\n"
"_surface.diffuse = vec4(col.r,col.b,col.g, 1.0);\n"
"_surface.emission = (_surface.reflective * _surface.reflective) * 2.0;\n"
"_surface.reflective = vec4(0.0);\n";
mat.shaderModifiers = shaders;
The different SCNShaderModifierEntryPointGeometry and PointSurfaces are key values with objects assigned to them. At the end we assign mat.shaderModifiers = shaders to assign both of these objects in the NSMutableDictionary to the material. So now the final result looks like the following:
Screen Shot 2014-07-25 at 7.09.39 PM
A wobbly pink jet. The significance of all of this is that to apply multiple shaders to the object you need to create a dictionary first, and use the different entrypoint constant values as keys. Hope this all made sense.
Read More
June 18, 2014
Looking for some Unreal Stuff?
http://okita.com/alex/unreal-game-development-archive/
The archives and what’s been going on can be found on the link above. Updates and adventures will be forthcoming as well as a few project announcements.
IMG_20140610_083914Making the most of a small workshop means approaching a critical density of stuff. I need to organize this into something more sensible, and some cool gizmos will be coming to this site soon. Check back often!
发表评论
-
iOS与JS交互实战篇(ObjC版)
2016-05-04 10:42 543转载于: iOS开发技术分享 前言 ObjectiveC与J ... -
Objective-C与JavaScript交互的那些事
2016-05-04 10:44 499转载于:http://www.cocoachina.com/i ... -
Import Cheetah3D Model in SceneKit
2015-01-23 16:18 783http://blog.manbolo.com/2014/08 ... -
Scene Kit (翻译)
2015-01-23 10:35 651前言 http://segmentfault.com/ ... -
iOS 图形编程总结
2015-01-22 11:07 679iOS实现图形编程可以 ... -
Introduction to Scene Kit
2015-01-21 14:35 508Scene Kit Programming Guide[/b] ... -
使用scenekit的时候不能打开程序
2015-01-21 13:59 642问题一: nib上能加载class 程序却找不到,在使用sce ... -
报错: dyld: Library not loaded
2015-01-21 13:02 1039一、问题 dyld: Library not loaded: ... -
iOS Sprite Kit最新特性Physics Field虚拟物理场Swift测试
2015-01-19 16:30 587转载于:http://blog.csdn.ne ... -
Sprite Kit编程指南(1)-深入Sprite Kit
2015-01-19 15:53 656Sprite Kit编程指南(1)- ...
相关推荐
SCNTechnique是SceneKit中的一个重要概念,它允许我们自定义渲染管道,实现更高级的图形效果。本文将深入探讨SCNTechnique的简单实现及其在iOS开发中的应用。 首先,我们需要理解SCNTechnique是什么。SCNTechnique...
在这个特定的项目“scenekit-outline-shader-scntechnique”中,我们将关注如何在Xcode 9.3中利用`SCNTechnique`来实现一种特定的着色效果——轮廓描边。这个项目提供了一个简单的游乐场(Playground)示例,展示了...
`SCNTechnique`是SceneKit提供的一种机制,用于自定义渲染管道,它允许开发者利用Metal的强大功能来扩展SceneKit的功能。 在"SCNTechniqueTest"这个示例中,我们有两个关键的演示点: 1. **法线渲染为纹理**: 这...
技术测试SCN技术实验此类的文献资料非常丰富,没有任何示例。... 该项目探索SceneKit的SCNTechnique类及其各种可配置参数。 到目前为止,我已经能够创建以下技术高斯模糊与噪声戴着面具的夜视
内容概要:本文档《数据结构》(02331)第一章主要介绍数据结构的基础概念,涵盖数据与数据元素的定义及其特性,详细阐述了数据结构的三大要素:逻辑结构、存储结构和数据运算。逻辑结构分为线性结构(如线性表、栈、队列)、树形结构(涉及根节点、父节点、子节点等术语)和其他结构。存储结构对比了顺序存储和链式存储的特点,包括访问方式、插入删除操作的时间复杂度以及空间分配方式,并介绍了索引存储和散列存储的概念。最后讲解了抽象数据类型(ADT)的定义及其组成部分,并探讨了算法分析中的时间复杂度计算方法。 适合人群:计算机相关专业学生或初学者,对数据结构有一定兴趣并希望系统学习其基础知识的人群。 使用场景及目标:①理解数据结构的基本概念,掌握逻辑结构和存储结构的区别与联系;②熟悉不同存储方式的特点及应用场景;③学会分析简单算法的时间复杂度,为后续深入学习打下坚实基础。 阅读建议:本章节内容较为理论化,建议结合实际案例进行理解,尤其是对于逻辑结构和存储结构的理解要深入到具体的应用场景中,同时可以尝试编写一些简单的程序来加深对抽象数据类型的认识。
内容概要:本文详细介绍了施耐德M580系列PLC的存储结构、系统硬件架构、上电写入程序及CPU冗余特性。在存储结构方面,涵盖拓扑寻址、Device DDT远程寻址以及寄存器寻址三种方式,详细解释了不同类型的寻址方法及其应用场景。系统硬件架构部分,阐述了最小系统的构建要素,包括CPU、机架和模块的选择与配置,并介绍了常见的系统拓扑结构,如简单的机架间拓扑和远程子站以太网菊花链等。上电写入程序环节,说明了通过USB和以太网两种接口进行程序下载的具体步骤,特别是针对初次下载时IP地址的设置方法。最后,CPU冗余部分重点描述了热备功能的实现机制,包括IP通讯地址配置和热备拓扑结构。 适合人群:从事工业自动化领域工作的技术人员,特别是对PLC编程及系统集成有一定了解的工程师。 使用场景及目标:①帮助工程师理解施耐德M580系列PLC的寻址机制,以便更好地进行模块配置和编程;②指导工程师完成最小系统的搭建,优化系统拓扑结构的设计;③提供详细的上电写入程序指南,确保程序下载顺利进行;④解释CPU冗余的实现方式,提高系统的稳定性和可靠性。 其他说明:文中还涉及一些特殊模块的功能介绍,如定时器事件和Modbus串口通讯模块,这些内容有助于用户深入了解M580系列PLC的高级应用。此外,附录部分提供了远程子站和热备冗余系统的实物图片,便于用户直观理解相关概念。
某型自动垂直提升仓储系统方案论证及关键零部件的设计.zip
2135D3F1EFA99CB590678658F575DB23.pdf#page=1&view=fitH
可以搜索文本内的内容,指定目录,指定文件格式,匹配大小写等
Windows 平台 Android Studio 下载与安装指南.zip
Android Studio Meerkat 2024.3.1 Patch 1(android-studio-2024.3.1.14-windows.zip)适用于Windows系统,文件使用360压缩软件分割成两个压缩包,必须一起下载使用: part1: https://download.csdn.net/download/weixin_43800734/90557033 part2: https://download.csdn.net/download/weixin_43800734/90557035
国网台区终端最新规范
国网台区终端最新规范
1.【锂电池剩余寿命预测】Transformer-GRU锂电池剩余寿命预测(Matlab完整源码和数据) 2.数据集:NASA数据集,已经处理好,B0005电池训练、B0006测试; 3.环境准备:Matlab2023b,可读性强; 4.模型描述:Transformer-GRU在各种各样的问题上表现非常出色,现在被广泛使用。 5.领域描述:近年来,随着锂离子电池的能量密度、功率密度逐渐提升,其安全性能与剩余使用寿命预测变得愈发重要。本代码实现了Transformer-GRU在该领域的应用。 6.作者介绍:机器学习之心,博客专家认证,机器学习领域创作者,2023博客之星TOP50,主做机器学习和深度学习时序、回归、分类、聚类和降维等程序设计和案例分析,文章底部有博主联系方式。从事Matlab、Python算法仿真工作8年,更多仿真源码、数据集定制私信。
Android项目原生java语言课程设计,包含LW+ppt
大学生入门前端-五子棋vue项目
这是一个完整的端到端解决方案,用于分析和预测阿联酋(UAE)地区的二手车价格。数据集包含 10,000 条二手车信息,覆盖了迪拜、阿布扎比和沙迦等城市,并提供了精确的地理位置数据。此外,项目还包括一个基于 Dash 构建的 Web 应用程序代码和一个训练好的 XGBoost 模型,帮助用户探索区域市场趋势、预测车价以及可视化地理空间洞察。 数据集内容 项目文件以压缩 ZIP 归档形式提供,包含以下内容: 数据文件: data/uae_used_cars_10k.csv:包含 10,000 条二手车记录的数据集,涵盖车辆品牌、型号、年份、里程数、发动机缸数、价格、变速箱类型、燃料类型、颜色、描述以及销售地点(如迪拜、阿布扎比、沙迦)。 模型文件: models/stacking_model.pkl:训练好的 XGBoost 模型,用于预测二手车价格。 models/scaler.pkl:用于数据预处理的缩放器。 models.py:模型相关功能的实现。 train_model.py:训练模型的脚本。 Web 应用程序文件: app.py:Dash 应用程序的主文件。 callback
资源内项目源码是来自个人的毕业设计,代码都测试ok,包含源码、数据集、可视化页面和部署说明,可产生核心指标曲线图、混淆矩阵、F1分数曲线、精确率-召回率曲线、验证集预测结果、标签分布图。都是运行成功后才上传资源,毕设答辩评审绝对信服的保底85分以上,放心下载使用,拿来就能用。包含源码、数据集、可视化页面和部署说明一站式服务,拿来就能用的绝对好资源!!! 项目备注 1、该资源内项目代码都经过测试运行成功,功能ok的情况下才上传的,请放心下载使用! 2、本项目适合计算机相关专业(如计科、人工智能、通信工程、自动化、电子信息等)的在校学生、老师或者企业员工下载学习,也适合小白学习进阶,当然也可作为毕设项目、课程设计、大作业、项目初期立项演示等。 3、如果基础还行,也可在此代码基础上进行修改,以实现其他功能,也可用于毕设、课设、作业等。 下载后请首先打开README.txt文件,仅供学习参考, 切勿用于商业用途。
资源内项目源码是来自个人的毕业设计,代码都测试ok,包含源码、数据集、可视化页面和部署说明,可产生核心指标曲线图、混淆矩阵、F1分数曲线、精确率-召回率曲线、验证集预测结果、标签分布图。都是运行成功后才上传资源,毕设答辩评审绝对信服的保底85分以上,放心下载使用,拿来就能用。包含源码、数据集、可视化页面和部署说明一站式服务,拿来就能用的绝对好资源!!! 项目备注 1、该资源内项目代码都经过测试运行成功,功能ok的情况下才上传的,请放心下载使用! 2、本项目适合计算机相关专业(如计科、人工智能、通信工程、自动化、电子信息等)的在校学生、老师或者企业员工下载学习,也适合小白学习进阶,当然也可作为毕设项目、课程设计、大作业、项目初期立项演示等。 3、如果基础还行,也可在此代码基础上进行修改,以实现其他功能,也可用于毕设、课设、作业等。 下载后请首先打开README.txt文件,仅供学习参考, 切勿用于商业用途。
此为代码审查工具 可查 文件数,字节数,总行数,代码行数,注释行数,空白行数,注释率等