ml-finance-python
python scripts for finance machine learning
git clone https://9o.is/git/ml-finance-python.git
05_bottleneck_features.ipynb
(248696B)
1 {
2 "cells": [
3 {
4 "cell_type": "markdown",
5 "metadata": {},
6 "source": [
7 "# How to extract bottleneck features"
8 ]
9 },
10 {
11 "cell_type": "markdown",
12 "metadata": {},
13 "source": [
14 "Modern CNNs can take weeks to train on multiple GPUs on ImageNet, but fortunately, many researchers share their final weights. Keras, e.g., contains pre-trained models for several of the reference architectures discussed above, namely VGG16 and 19, ResNet50, InceptionV3 and InceptionResNetV2, MobileNet, DenseNet, NASNet and MobileNetV2\n",
15 "\n",
16 "This notebook illustrates how to download pre-trained VGG16 model, either with the final layers to generate predictions or without the final layers as illustrated in the figure below to extract the outputs produced by the bottleneck features."
17 ]
18 },
19 {
20 "cell_type": "markdown",
21 "metadata": {},
22 "source": [
23 "## Imports"
24 ]
25 },
26 {
27 "cell_type": "code",
28 "execution_count": 6,
29 "metadata": {},
30 "outputs": [],
31 "source": [
32 "from keras.applications.vgg19 import VGG19, preprocess_input\n",
33 "from keras.applications.vgg16 import VGG16\n",
34 "from keras.applications.inception_v3 import InceptionV3\n",
35 "from keras.applications.resnet50 import ResNet50\n",
36 "from keras.preprocessing import image\n",
37 "import keras.backend as K\n",
38 "import numpy as np\n",
39 "from pathlib import Path"
40 ]
41 },
42 {
43 "cell_type": "markdown",
44 "metadata": {},
45 "source": [
46 "## Load and Preprocess Sample Images\n",
47 "\n",
48 "Before supplying an image to a pre-trained network in Keras, there are some required preprocessing steps.\n",
49 "\n",
50 "We have imported a very small dataset of 7\n",
51 "images and stored the preprocessed image input as `img_input`. Note that the dimensionality of this array is `(8, 224, 224, 3)`. In this case, each of the 8 images is a 3D tensor, with shape `(224, 224, 3)`."
52 ]
53 },
54 {
55 "cell_type": "code",
56 "execution_count": 11,
57 "metadata": {},
58 "outputs": [],
59 "source": [
60 "img_paths = Path('images/img_input').glob('*.jpg')"
61 ]
62 },
63 {
64 "cell_type": "code",
65 "execution_count": 12,
66 "metadata": {},
67 "outputs": [],
68 "source": [
69 "def path_to_tensor(img_path):\n",
70 " # loads RGB image as PIL.Image.Image type\n",
71 " img = image.load_img(img_path, target_size=(224, 224))\n",
72 " # convert PIL.Image.Image type to 3D tensor with shape (224, 224, 3)\n",
73 " x = image.img_to_array(img)\n",
74 " # convert 3D tensor to 4D tensor with shape (1, 224, 224, 3) and return 4D tensor\n",
75 " return np.expand_dims(x, axis=0)"
76 ]
77 },
78 {
79 "cell_type": "code",
80 "execution_count": 13,
81 "metadata": {},
82 "outputs": [],
83 "source": [
84 "def paths_to_tensor(img_paths):\n",
85 " list_of_tensors = [path_to_tensor(img_path) for img_path in img_paths]\n",
86 " return np.vstack(list_of_tensors)"
87 ]
88 },
89 {
90 "cell_type": "code",
91 "execution_count": 14,
92 "metadata": {},
93 "outputs": [
94 {
95 "data": {
96 "text/plain": [
97 "(7, 224, 224, 3)"
98 ]
99 },
100 "execution_count": 14,
101 "metadata": {},
102 "output_type": "execute_result"
103 }
104 ],
105 "source": [
106 "# calculate the image input\n",
107 "img_input = preprocess_input(paths_to_tensor(img_paths))\n",
108 "\n",
109 "img_input.shape"
110 ]
111 },
112 {
113 "cell_type": "markdown",
114 "metadata": {},
115 "source": [
116 "## Import Pre-Trained VGG-19\n",
117 "\n",
118 "Import the VGG-16 network (including the final classification layer) that has been pre-trained on ImageNet.\n",
119 "\n",
120 ""
121 ]
122 },
123 {
124 "cell_type": "markdown",
125 "metadata": {},
126 "source": [
127 "Keras makes it very straightforward to download and use pre-trained models:"
128 ]
129 },
130 {
131 "cell_type": "code",
132 "execution_count": 15,
133 "metadata": {
134 "ExecuteTime": {
135 "end_time": "2017-06-06T01:14:28.300890Z",
136 "start_time": "2017-06-06T01:13:22.262466Z"
137 },
138 "scrolled": false
139 },
140 "outputs": [
141 {
142 "name": "stdout",
143 "output_type": "stream",
144 "text": [
145 "WARNING:tensorflow:From /home/stefan/.pyenv/versions/miniconda3-latest/envs/ml4t/lib/python3.6/site-packages/tensorflow/python/framework/op_def_library.py:263: colocate_with (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version.\n",
146 "Instructions for updating:\n",
147 "Colocations handled automatically by placer.\n",
148 "_________________________________________________________________\n",
149 "Layer (type) Output Shape Param # \n",
150 "=================================================================\n",
151 "input_1 (InputLayer) (None, 224, 224, 3) 0 \n",
152 "_________________________________________________________________\n",
153 "block1_conv1 (Conv2D) (None, 224, 224, 64) 1792 \n",
154 "_________________________________________________________________\n",
155 "block1_conv2 (Conv2D) (None, 224, 224, 64) 36928 \n",
156 "_________________________________________________________________\n",
157 "block1_pool (MaxPooling2D) (None, 112, 112, 64) 0 \n",
158 "_________________________________________________________________\n",
159 "block2_conv1 (Conv2D) (None, 112, 112, 128) 73856 \n",
160 "_________________________________________________________________\n",
161 "block2_conv2 (Conv2D) (None, 112, 112, 128) 147584 \n",
162 "_________________________________________________________________\n",
163 "block2_pool (MaxPooling2D) (None, 56, 56, 128) 0 \n",
164 "_________________________________________________________________\n",
165 "block3_conv1 (Conv2D) (None, 56, 56, 256) 295168 \n",
166 "_________________________________________________________________\n",
167 "block3_conv2 (Conv2D) (None, 56, 56, 256) 590080 \n",
168 "_________________________________________________________________\n",
169 "block3_conv3 (Conv2D) (None, 56, 56, 256) 590080 \n",
170 "_________________________________________________________________\n",
171 "block3_conv4 (Conv2D) (None, 56, 56, 256) 590080 \n",
172 "_________________________________________________________________\n",
173 "block3_pool (MaxPooling2D) (None, 28, 28, 256) 0 \n",
174 "_________________________________________________________________\n",
175 "block4_conv1 (Conv2D) (None, 28, 28, 512) 1180160 \n",
176 "_________________________________________________________________\n",
177 "block4_conv2 (Conv2D) (None, 28, 28, 512) 2359808 \n",
178 "_________________________________________________________________\n",
179 "block4_conv3 (Conv2D) (None, 28, 28, 512) 2359808 \n",
180 "_________________________________________________________________\n",
181 "block4_conv4 (Conv2D) (None, 28, 28, 512) 2359808 \n",
182 "_________________________________________________________________\n",
183 "block4_pool (MaxPooling2D) (None, 14, 14, 512) 0 \n",
184 "_________________________________________________________________\n",
185 "block5_conv1 (Conv2D) (None, 14, 14, 512) 2359808 \n",
186 "_________________________________________________________________\n",
187 "block5_conv2 (Conv2D) (None, 14, 14, 512) 2359808 \n",
188 "_________________________________________________________________\n",
189 "block5_conv3 (Conv2D) (None, 14, 14, 512) 2359808 \n",
190 "_________________________________________________________________\n",
191 "block5_conv4 (Conv2D) (None, 14, 14, 512) 2359808 \n",
192 "_________________________________________________________________\n",
193 "block5_pool (MaxPooling2D) (None, 7, 7, 512) 0 \n",
194 "_________________________________________________________________\n",
195 "flatten (Flatten) (None, 25088) 0 \n",
196 "_________________________________________________________________\n",
197 "fc1 (Dense) (None, 4096) 102764544 \n",
198 "_________________________________________________________________\n",
199 "fc2 (Dense) (None, 4096) 16781312 \n",
200 "_________________________________________________________________\n",
201 "predictions (Dense) (None, 1000) 4097000 \n",
202 "=================================================================\n",
203 "Total params: 143,667,240\n",
204 "Trainable params: 143,667,240\n",
205 "Non-trainable params: 0\n",
206 "_________________________________________________________________\n"
207 ]
208 }
209 ],
210 "source": [
211 "vgg19 = VGG19()\n",
212 "vgg19.summary()"
213 ]
214 },
215 {
216 "cell_type": "markdown",
217 "metadata": {},
218 "source": [
219 "For this network, `model.predict` returns a 1000-dimensional probability vector containing the predicted probability that an image returns each of the 1000 ImageNet categories. The dimensionality of the obtained output from passing `img_input` through the model is `(8, 1000)`. The first value of `7` merely denotes that 7 images were passed through the network."
220 ]
221 },
222 {
223 "cell_type": "code",
224 "execution_count": 17,
225 "metadata": {},
226 "outputs": [
227 {
228 "data": {
229 "text/plain": [
230 "(7, 1000)"
231 ]
232 },
233 "execution_count": 17,
234 "metadata": {},
235 "output_type": "execute_result"
236 }
237 ],
238 "source": [
239 "y_pred = vgg19.predict(img_input)\n",
240 "y_pred.shape"
241 ]
242 },
243 {
244 "cell_type": "code",
245 "execution_count": 18,
246 "metadata": {},
247 "outputs": [
248 {
249 "data": {
250 "text/plain": [
251 "array([218, 205, 215, 211, 208, 221, 206])"
252 ]
253 },
254 "execution_count": 18,
255 "metadata": {},
256 "output_type": "execute_result"
257 }
258 ],
259 "source": [
260 "np.argmax(y_pred, axis=1)"
261 ]
262 },
263 {
264 "cell_type": "markdown",
265 "metadata": {},
266 "source": [
267 "## Import the VGG-16 Model, with the Final Fully-Connected Layers Removed\n",
268 "\n",
269 "When performing transfer learning, we need to remove the final layers of the network, as they are too specific to the ImageNet database. This is accomplished in the code cell below.\n",
270 "\n",
271 ""
272 ]
273 },
274 {
275 "cell_type": "markdown",
276 "metadata": {},
277 "source": [
278 "You can use this model like any other Keras model for predictions. To exclude the fully-connected layers, just add the keyword `include_top=False` to obtain the output of the final convolutional layer when passing an image to the CNN."
279 ]
280 },
281 {
282 "cell_type": "code",
283 "execution_count": 19,
284 "metadata": {},
285 "outputs": [
286 {
287 "name": "stdout",
288 "output_type": "stream",
289 "text": [
290 "Downloading data from https://github.com/fchollet/deep-learning-models/releases/download/v0.1/vgg19_weights_tf_dim_ordering_tf_kernels_notop.h5\n",
291 "80142336/80134624 [==============================] - 5s 0us/step\n",
292 "_________________________________________________________________\n",
293 "Layer (type) Output Shape Param # \n",
294 "=================================================================\n",
295 "input_2 (InputLayer) (None, None, None, 3) 0 \n",
296 "_________________________________________________________________\n",
297 "block1_conv1 (Conv2D) (None, None, None, 64) 1792 \n",
298 "_________________________________________________________________\n",
299 "block1_conv2 (Conv2D) (None, None, None, 64) 36928 \n",
300 "_________________________________________________________________\n",
301 "block1_pool (MaxPooling2D) (None, None, None, 64) 0 \n",
302 "_________________________________________________________________\n",
303 "block2_conv1 (Conv2D) (None, None, None, 128) 73856 \n",
304 "_________________________________________________________________\n",
305 "block2_conv2 (Conv2D) (None, None, None, 128) 147584 \n",
306 "_________________________________________________________________\n",
307 "block2_pool (MaxPooling2D) (None, None, None, 128) 0 \n",
308 "_________________________________________________________________\n",
309 "block3_conv1 (Conv2D) (None, None, None, 256) 295168 \n",
310 "_________________________________________________________________\n",
311 "block3_conv2 (Conv2D) (None, None, None, 256) 590080 \n",
312 "_________________________________________________________________\n",
313 "block3_conv3 (Conv2D) (None, None, None, 256) 590080 \n",
314 "_________________________________________________________________\n",
315 "block3_conv4 (Conv2D) (None, None, None, 256) 590080 \n",
316 "_________________________________________________________________\n",
317 "block3_pool (MaxPooling2D) (None, None, None, 256) 0 \n",
318 "_________________________________________________________________\n",
319 "block4_conv1 (Conv2D) (None, None, None, 512) 1180160 \n",
320 "_________________________________________________________________\n",
321 "block4_conv2 (Conv2D) (None, None, None, 512) 2359808 \n",
322 "_________________________________________________________________\n",
323 "block4_conv3 (Conv2D) (None, None, None, 512) 2359808 \n",
324 "_________________________________________________________________\n",
325 "block4_conv4 (Conv2D) (None, None, None, 512) 2359808 \n",
326 "_________________________________________________________________\n",
327 "block4_pool (MaxPooling2D) (None, None, None, 512) 0 \n",
328 "_________________________________________________________________\n",
329 "block5_conv1 (Conv2D) (None, None, None, 512) 2359808 \n",
330 "_________________________________________________________________\n",
331 "block5_conv2 (Conv2D) (None, None, None, 512) 2359808 \n",
332 "_________________________________________________________________\n",
333 "block5_conv3 (Conv2D) (None, None, None, 512) 2359808 \n",
334 "_________________________________________________________________\n",
335 "block5_conv4 (Conv2D) (None, None, None, 512) 2359808 \n",
336 "_________________________________________________________________\n",
337 "block5_pool (MaxPooling2D) (None, None, None, 512) 0 \n",
338 "=================================================================\n",
339 "Total params: 20,024,384\n",
340 "Trainable params: 20,024,384\n",
341 "Non-trainable params: 0\n",
342 "_________________________________________________________________\n"
343 ]
344 }
345 ],
346 "source": [
347 "vgg19 = VGG19(include_top=False)\n",
348 "vgg19.summary()"
349 ]
350 },
351 {
352 "cell_type": "markdown",
353 "metadata": {},
354 "source": [
355 "By omitting the fully-connected layers, we are no longer forced to use a fixed input size for the model (224x224, the original ImageNet format). By only keeping the convolutional modules, our model can be adapted to arbitrary input sizes."
356 ]
357 },
358 {
359 "cell_type": "markdown",
360 "metadata": {},
361 "source": [
362 "### Extract Output of Final Max Pooling Layer\n",
363 "\n",
364 "Now, the network stored in `model` is a truncated version of the VGG-16 network, where the final three fully-connected layers have been removed. In this case, `model.predict` returns a 3D array (with dimensions $7\\times 7\\times 512$) corresponding to the final max pooling layer of VGG-16. The dimensionality of the obtained output from passing `img_input` through the model is `(8, 7, 7, 512)`. The first value of `8` merely denotes that 8 images were passed through the network. "
365 ]
366 },
367 {
368 "cell_type": "code",
369 "execution_count": 20,
370 "metadata": {},
371 "outputs": [
372 {
373 "data": {
374 "text/plain": [
375 "(7, 7, 7, 512)"
376 ]
377 },
378 "execution_count": 20,
379 "metadata": {},
380 "output_type": "execute_result"
381 }
382 ],
383 "source": [
384 "vgg19.predict(img_input).shape"
385 ]
386 },
387 {
388 "cell_type": "markdown",
389 "metadata": {},
390 "source": [
391 "This is exactly how we calculate the bottleneck features for your project!"
392 ]
393 },
394 {
395 "cell_type": "markdown",
396 "metadata": {},
397 "source": [
398 "## Import ResNet50"
399 ]
400 },
401 {
402 "cell_type": "markdown",
403 "metadata": {},
404 "source": [
405 "### With final layer"
406 ]
407 },
408 {
409 "cell_type": "code",
410 "execution_count": 21,
411 "metadata": {
412 "ExecuteTime": {
413 "end_time": "2017-06-06T01:47:15.760897Z",
414 "start_time": "2017-06-06T01:46:51.343612Z"
415 }
416 },
417 "outputs": [
418 {
419 "name": "stdout",
420 "output_type": "stream",
421 "text": [
422 "__________________________________________________________________________________________________\n",
423 "Layer (type) Output Shape Param # Connected to \n",
424 "==================================================================================================\n",
425 "input_3 (InputLayer) (None, 224, 224, 3) 0 \n",
426 "__________________________________________________________________________________________________\n",
427 "conv1_pad (ZeroPadding2D) (None, 230, 230, 3) 0 input_3[0][0] \n",
428 "__________________________________________________________________________________________________\n",
429 "conv1 (Conv2D) (None, 112, 112, 64) 9472 conv1_pad[0][0] \n",
430 "__________________________________________________________________________________________________\n",
431 "bn_conv1 (BatchNormalization) (None, 112, 112, 64) 256 conv1[0][0] \n",
432 "__________________________________________________________________________________________________\n",
433 "activation_1 (Activation) (None, 112, 112, 64) 0 bn_conv1[0][0] \n",
434 "__________________________________________________________________________________________________\n",
435 "pool1_pad (ZeroPadding2D) (None, 114, 114, 64) 0 activation_1[0][0] \n",
436 "__________________________________________________________________________________________________\n",
437 "max_pooling2d_1 (MaxPooling2D) (None, 56, 56, 64) 0 pool1_pad[0][0] \n",
438 "__________________________________________________________________________________________________\n",
439 "res2a_branch2a (Conv2D) (None, 56, 56, 64) 4160 max_pooling2d_1[0][0] \n",
440 "__________________________________________________________________________________________________\n",
441 "bn2a_branch2a (BatchNormalizati (None, 56, 56, 64) 256 res2a_branch2a[0][0] \n",
442 "__________________________________________________________________________________________________\n",
443 "activation_2 (Activation) (None, 56, 56, 64) 0 bn2a_branch2a[0][0] \n",
444 "__________________________________________________________________________________________________\n",
445 "res2a_branch2b (Conv2D) (None, 56, 56, 64) 36928 activation_2[0][0] \n",
446 "__________________________________________________________________________________________________\n",
447 "bn2a_branch2b (BatchNormalizati (None, 56, 56, 64) 256 res2a_branch2b[0][0] \n",
448 "__________________________________________________________________________________________________\n",
449 "activation_3 (Activation) (None, 56, 56, 64) 0 bn2a_branch2b[0][0] \n",
450 "__________________________________________________________________________________________________\n",
451 "res2a_branch2c (Conv2D) (None, 56, 56, 256) 16640 activation_3[0][0] \n",
452 "__________________________________________________________________________________________________\n",
453 "res2a_branch1 (Conv2D) (None, 56, 56, 256) 16640 max_pooling2d_1[0][0] \n",
454 "__________________________________________________________________________________________________\n",
455 "bn2a_branch2c (BatchNormalizati (None, 56, 56, 256) 1024 res2a_branch2c[0][0] \n",
456 "__________________________________________________________________________________________________\n",
457 "bn2a_branch1 (BatchNormalizatio (None, 56, 56, 256) 1024 res2a_branch1[0][0] \n",
458 "__________________________________________________________________________________________________\n",
459 "add_1 (Add) (None, 56, 56, 256) 0 bn2a_branch2c[0][0] \n",
460 " bn2a_branch1[0][0] \n",
461 "__________________________________________________________________________________________________\n",
462 "activation_4 (Activation) (None, 56, 56, 256) 0 add_1[0][0] \n",
463 "__________________________________________________________________________________________________\n",
464 "res2b_branch2a (Conv2D) (None, 56, 56, 64) 16448 activation_4[0][0] \n",
465 "__________________________________________________________________________________________________\n",
466 "bn2b_branch2a (BatchNormalizati (None, 56, 56, 64) 256 res2b_branch2a[0][0] \n",
467 "__________________________________________________________________________________________________\n",
468 "activation_5 (Activation) (None, 56, 56, 64) 0 bn2b_branch2a[0][0] \n",
469 "__________________________________________________________________________________________________\n",
470 "res2b_branch2b (Conv2D) (None, 56, 56, 64) 36928 activation_5[0][0] \n",
471 "__________________________________________________________________________________________________\n",
472 "bn2b_branch2b (BatchNormalizati (None, 56, 56, 64) 256 res2b_branch2b[0][0] \n",
473 "__________________________________________________________________________________________________\n",
474 "activation_6 (Activation) (None, 56, 56, 64) 0 bn2b_branch2b[0][0] \n",
475 "__________________________________________________________________________________________________\n",
476 "res2b_branch2c (Conv2D) (None, 56, 56, 256) 16640 activation_6[0][0] \n",
477 "__________________________________________________________________________________________________\n",
478 "bn2b_branch2c (BatchNormalizati (None, 56, 56, 256) 1024 res2b_branch2c[0][0] \n",
479 "__________________________________________________________________________________________________\n",
480 "add_2 (Add) (None, 56, 56, 256) 0 bn2b_branch2c[0][0] \n",
481 " activation_4[0][0] \n",
482 "__________________________________________________________________________________________________\n",
483 "activation_7 (Activation) (None, 56, 56, 256) 0 add_2[0][0] \n",
484 "__________________________________________________________________________________________________\n",
485 "res2c_branch2a (Conv2D) (None, 56, 56, 64) 16448 activation_7[0][0] \n",
486 "__________________________________________________________________________________________________\n",
487 "bn2c_branch2a (BatchNormalizati (None, 56, 56, 64) 256 res2c_branch2a[0][0] \n",
488 "__________________________________________________________________________________________________\n",
489 "activation_8 (Activation) (None, 56, 56, 64) 0 bn2c_branch2a[0][0] \n",
490 "__________________________________________________________________________________________________\n",
491 "res2c_branch2b (Conv2D) (None, 56, 56, 64) 36928 activation_8[0][0] \n",
492 "__________________________________________________________________________________________________\n",
493 "bn2c_branch2b (BatchNormalizati (None, 56, 56, 64) 256 res2c_branch2b[0][0] \n",
494 "__________________________________________________________________________________________________\n",
495 "activation_9 (Activation) (None, 56, 56, 64) 0 bn2c_branch2b[0][0] \n",
496 "__________________________________________________________________________________________________\n",
497 "res2c_branch2c (Conv2D) (None, 56, 56, 256) 16640 activation_9[0][0] \n",
498 "__________________________________________________________________________________________________\n",
499 "bn2c_branch2c (BatchNormalizati (None, 56, 56, 256) 1024 res2c_branch2c[0][0] \n",
500 "__________________________________________________________________________________________________\n",
501 "add_3 (Add) (None, 56, 56, 256) 0 bn2c_branch2c[0][0] \n",
502 " activation_7[0][0] \n",
503 "__________________________________________________________________________________________________\n",
504 "activation_10 (Activation) (None, 56, 56, 256) 0 add_3[0][0] \n",
505 "__________________________________________________________________________________________________\n",
506 "res3a_branch2a (Conv2D) (None, 28, 28, 128) 32896 activation_10[0][0] \n",
507 "__________________________________________________________________________________________________\n",
508 "bn3a_branch2a (BatchNormalizati (None, 28, 28, 128) 512 res3a_branch2a[0][0] \n",
509 "__________________________________________________________________________________________________\n",
510 "activation_11 (Activation) (None, 28, 28, 128) 0 bn3a_branch2a[0][0] \n",
511 "__________________________________________________________________________________________________\n",
512 "res3a_branch2b (Conv2D) (None, 28, 28, 128) 147584 activation_11[0][0] \n",
513 "__________________________________________________________________________________________________\n",
514 "bn3a_branch2b (BatchNormalizati (None, 28, 28, 128) 512 res3a_branch2b[0][0] \n",
515 "__________________________________________________________________________________________________\n",
516 "activation_12 (Activation) (None, 28, 28, 128) 0 bn3a_branch2b[0][0] \n",
517 "__________________________________________________________________________________________________\n",
518 "res3a_branch2c (Conv2D) (None, 28, 28, 512) 66048 activation_12[0][0] \n",
519 "__________________________________________________________________________________________________\n",
520 "res3a_branch1 (Conv2D) (None, 28, 28, 512) 131584 activation_10[0][0] \n",
521 "__________________________________________________________________________________________________\n",
522 "bn3a_branch2c (BatchNormalizati (None, 28, 28, 512) 2048 res3a_branch2c[0][0] \n",
523 "__________________________________________________________________________________________________\n",
524 "bn3a_branch1 (BatchNormalizatio (None, 28, 28, 512) 2048 res3a_branch1[0][0] \n",
525 "__________________________________________________________________________________________________\n",
526 "add_4 (Add) (None, 28, 28, 512) 0 bn3a_branch2c[0][0] \n",
527 " bn3a_branch1[0][0] \n",
528 "__________________________________________________________________________________________________\n",
529 "activation_13 (Activation) (None, 28, 28, 512) 0 add_4[0][0] \n",
530 "__________________________________________________________________________________________________\n",
531 "res3b_branch2a (Conv2D) (None, 28, 28, 128) 65664 activation_13[0][0] \n",
532 "__________________________________________________________________________________________________\n",
533 "bn3b_branch2a (BatchNormalizati (None, 28, 28, 128) 512 res3b_branch2a[0][0] \n",
534 "__________________________________________________________________________________________________\n",
535 "activation_14 (Activation) (None, 28, 28, 128) 0 bn3b_branch2a[0][0] \n",
536 "__________________________________________________________________________________________________\n",
537 "res3b_branch2b (Conv2D) (None, 28, 28, 128) 147584 activation_14[0][0] \n",
538 "__________________________________________________________________________________________________\n",
539 "bn3b_branch2b (BatchNormalizati (None, 28, 28, 128) 512 res3b_branch2b[0][0] \n",
540 "__________________________________________________________________________________________________\n",
541 "activation_15 (Activation) (None, 28, 28, 128) 0 bn3b_branch2b[0][0] \n",
542 "__________________________________________________________________________________________________\n",
543 "res3b_branch2c (Conv2D) (None, 28, 28, 512) 66048 activation_15[0][0] \n",
544 "__________________________________________________________________________________________________\n",
545 "bn3b_branch2c (BatchNormalizati (None, 28, 28, 512) 2048 res3b_branch2c[0][0] \n",
546 "__________________________________________________________________________________________________\n",
547 "add_5 (Add) (None, 28, 28, 512) 0 bn3b_branch2c[0][0] \n",
548 " activation_13[0][0] \n",
549 "__________________________________________________________________________________________________\n",
550 "activation_16 (Activation) (None, 28, 28, 512) 0 add_5[0][0] \n",
551 "__________________________________________________________________________________________________\n",
552 "res3c_branch2a (Conv2D) (None, 28, 28, 128) 65664 activation_16[0][0] \n",
553 "__________________________________________________________________________________________________\n",
554 "bn3c_branch2a (BatchNormalizati (None, 28, 28, 128) 512 res3c_branch2a[0][0] \n",
555 "__________________________________________________________________________________________________\n",
556 "activation_17 (Activation) (None, 28, 28, 128) 0 bn3c_branch2a[0][0] \n",
557 "__________________________________________________________________________________________________\n",
558 "res3c_branch2b (Conv2D) (None, 28, 28, 128) 147584 activation_17[0][0] \n",
559 "__________________________________________________________________________________________________\n",
560 "bn3c_branch2b (BatchNormalizati (None, 28, 28, 128) 512 res3c_branch2b[0][0] \n",
561 "__________________________________________________________________________________________________\n",
562 "activation_18 (Activation) (None, 28, 28, 128) 0 bn3c_branch2b[0][0] \n",
563 "__________________________________________________________________________________________________\n",
564 "res3c_branch2c (Conv2D) (None, 28, 28, 512) 66048 activation_18[0][0] \n",
565 "__________________________________________________________________________________________________\n",
566 "bn3c_branch2c (BatchNormalizati (None, 28, 28, 512) 2048 res3c_branch2c[0][0] \n",
567 "__________________________________________________________________________________________________\n",
568 "add_6 (Add) (None, 28, 28, 512) 0 bn3c_branch2c[0][0] \n",
569 " activation_16[0][0] \n",
570 "__________________________________________________________________________________________________\n",
571 "activation_19 (Activation) (None, 28, 28, 512) 0 add_6[0][0] \n",
572 "__________________________________________________________________________________________________\n",
573 "res3d_branch2a (Conv2D) (None, 28, 28, 128) 65664 activation_19[0][0] \n",
574 "__________________________________________________________________________________________________\n",
575 "bn3d_branch2a (BatchNormalizati (None, 28, 28, 128) 512 res3d_branch2a[0][0] \n",
576 "__________________________________________________________________________________________________\n",
577 "activation_20 (Activation) (None, 28, 28, 128) 0 bn3d_branch2a[0][0] \n",
578 "__________________________________________________________________________________________________\n",
579 "res3d_branch2b (Conv2D) (None, 28, 28, 128) 147584 activation_20[0][0] \n",
580 "__________________________________________________________________________________________________\n",
581 "bn3d_branch2b (BatchNormalizati (None, 28, 28, 128) 512 res3d_branch2b[0][0] \n",
582 "__________________________________________________________________________________________________\n",
583 "activation_21 (Activation) (None, 28, 28, 128) 0 bn3d_branch2b[0][0] \n",
584 "__________________________________________________________________________________________________\n",
585 "res3d_branch2c (Conv2D) (None, 28, 28, 512) 66048 activation_21[0][0] \n",
586 "__________________________________________________________________________________________________\n",
587 "bn3d_branch2c (BatchNormalizati (None, 28, 28, 512) 2048 res3d_branch2c[0][0] \n",
588 "__________________________________________________________________________________________________\n",
589 "add_7 (Add) (None, 28, 28, 512) 0 bn3d_branch2c[0][0] \n",
590 " activation_19[0][0] \n",
591 "__________________________________________________________________________________________________\n",
592 "activation_22 (Activation) (None, 28, 28, 512) 0 add_7[0][0] \n",
593 "__________________________________________________________________________________________________\n",
594 "res4a_branch2a (Conv2D) (None, 14, 14, 256) 131328 activation_22[0][0] \n",
595 "__________________________________________________________________________________________________\n",
596 "bn4a_branch2a (BatchNormalizati (None, 14, 14, 256) 1024 res4a_branch2a[0][0] \n",
597 "__________________________________________________________________________________________________\n",
598 "activation_23 (Activation) (None, 14, 14, 256) 0 bn4a_branch2a[0][0] \n",
599 "__________________________________________________________________________________________________\n",
600 "res4a_branch2b (Conv2D) (None, 14, 14, 256) 590080 activation_23[0][0] \n",
601 "__________________________________________________________________________________________________\n",
602 "bn4a_branch2b (BatchNormalizati (None, 14, 14, 256) 1024 res4a_branch2b[0][0] \n",
603 "__________________________________________________________________________________________________\n",
604 "activation_24 (Activation) (None, 14, 14, 256) 0 bn4a_branch2b[0][0] \n",
605 "__________________________________________________________________________________________________\n",
606 "res4a_branch2c (Conv2D) (None, 14, 14, 1024) 263168 activation_24[0][0] \n",
607 "__________________________________________________________________________________________________\n",
608 "res4a_branch1 (Conv2D) (None, 14, 14, 1024) 525312 activation_22[0][0] \n",
609 "__________________________________________________________________________________________________\n",
610 "bn4a_branch2c (BatchNormalizati (None, 14, 14, 1024) 4096 res4a_branch2c[0][0] \n",
611 "__________________________________________________________________________________________________\n",
612 "bn4a_branch1 (BatchNormalizatio (None, 14, 14, 1024) 4096 res4a_branch1[0][0] \n",
613 "__________________________________________________________________________________________________\n",
614 "add_8 (Add) (None, 14, 14, 1024) 0 bn4a_branch2c[0][0] \n",
615 " bn4a_branch1[0][0] \n",
616 "__________________________________________________________________________________________________\n",
617 "activation_25 (Activation) (None, 14, 14, 1024) 0 add_8[0][0] \n",
618 "__________________________________________________________________________________________________\n",
619 "res4b_branch2a (Conv2D) (None, 14, 14, 256) 262400 activation_25[0][0] \n",
620 "__________________________________________________________________________________________________\n",
621 "bn4b_branch2a (BatchNormalizati (None, 14, 14, 256) 1024 res4b_branch2a[0][0] \n",
622 "__________________________________________________________________________________________________\n",
623 "activation_26 (Activation) (None, 14, 14, 256) 0 bn4b_branch2a[0][0] \n",
624 "__________________________________________________________________________________________________\n",
625 "res4b_branch2b (Conv2D) (None, 14, 14, 256) 590080 activation_26[0][0] \n",
626 "__________________________________________________________________________________________________\n",
627 "bn4b_branch2b (BatchNormalizati (None, 14, 14, 256) 1024 res4b_branch2b[0][0] \n",
628 "__________________________________________________________________________________________________\n",
629 "activation_27 (Activation) (None, 14, 14, 256) 0 bn4b_branch2b[0][0] \n",
630 "__________________________________________________________________________________________________\n",
631 "res4b_branch2c (Conv2D) (None, 14, 14, 1024) 263168 activation_27[0][0] \n",
632 "__________________________________________________________________________________________________\n",
633 "bn4b_branch2c (BatchNormalizati (None, 14, 14, 1024) 4096 res4b_branch2c[0][0] \n",
634 "__________________________________________________________________________________________________\n",
635 "add_9 (Add) (None, 14, 14, 1024) 0 bn4b_branch2c[0][0] \n",
636 " activation_25[0][0] \n",
637 "__________________________________________________________________________________________________\n",
638 "activation_28 (Activation) (None, 14, 14, 1024) 0 add_9[0][0] \n",
639 "__________________________________________________________________________________________________\n",
640 "res4c_branch2a (Conv2D) (None, 14, 14, 256) 262400 activation_28[0][0] \n",
641 "__________________________________________________________________________________________________\n",
642 "bn4c_branch2a (BatchNormalizati (None, 14, 14, 256) 1024 res4c_branch2a[0][0] \n",
643 "__________________________________________________________________________________________________\n",
644 "activation_29 (Activation) (None, 14, 14, 256) 0 bn4c_branch2a[0][0] \n",
645 "__________________________________________________________________________________________________\n",
646 "res4c_branch2b (Conv2D) (None, 14, 14, 256) 590080 activation_29[0][0] \n",
647 "__________________________________________________________________________________________________\n",
648 "bn4c_branch2b (BatchNormalizati (None, 14, 14, 256) 1024 res4c_branch2b[0][0] \n",
649 "__________________________________________________________________________________________________\n",
650 "activation_30 (Activation) (None, 14, 14, 256) 0 bn4c_branch2b[0][0] \n",
651 "__________________________________________________________________________________________________\n",
652 "res4c_branch2c (Conv2D) (None, 14, 14, 1024) 263168 activation_30[0][0] \n",
653 "__________________________________________________________________________________________________\n",
654 "bn4c_branch2c (BatchNormalizati (None, 14, 14, 1024) 4096 res4c_branch2c[0][0] \n",
655 "__________________________________________________________________________________________________\n",
656 "add_10 (Add) (None, 14, 14, 1024) 0 bn4c_branch2c[0][0] \n",
657 " activation_28[0][0] \n",
658 "__________________________________________________________________________________________________\n",
659 "activation_31 (Activation) (None, 14, 14, 1024) 0 add_10[0][0] \n",
660 "__________________________________________________________________________________________________\n",
661 "res4d_branch2a (Conv2D) (None, 14, 14, 256) 262400 activation_31[0][0] \n",
662 "__________________________________________________________________________________________________\n",
663 "bn4d_branch2a (BatchNormalizati (None, 14, 14, 256) 1024 res4d_branch2a[0][0] \n",
664 "__________________________________________________________________________________________________\n",
665 "activation_32 (Activation) (None, 14, 14, 256) 0 bn4d_branch2a[0][0] \n",
666 "__________________________________________________________________________________________________\n",
667 "res4d_branch2b (Conv2D) (None, 14, 14, 256) 590080 activation_32[0][0] \n",
668 "__________________________________________________________________________________________________\n",
669 "bn4d_branch2b (BatchNormalizati (None, 14, 14, 256) 1024 res4d_branch2b[0][0] \n",
670 "__________________________________________________________________________________________________\n",
671 "activation_33 (Activation) (None, 14, 14, 256) 0 bn4d_branch2b[0][0] \n",
672 "__________________________________________________________________________________________________\n",
673 "res4d_branch2c (Conv2D) (None, 14, 14, 1024) 263168 activation_33[0][0] \n",
674 "__________________________________________________________________________________________________\n",
675 "bn4d_branch2c (BatchNormalizati (None, 14, 14, 1024) 4096 res4d_branch2c[0][0] \n",
676 "__________________________________________________________________________________________________\n",
677 "add_11 (Add) (None, 14, 14, 1024) 0 bn4d_branch2c[0][0] \n",
678 " activation_31[0][0] \n",
679 "__________________________________________________________________________________________________\n",
680 "activation_34 (Activation) (None, 14, 14, 1024) 0 add_11[0][0] \n",
681 "__________________________________________________________________________________________________\n",
682 "res4e_branch2a (Conv2D) (None, 14, 14, 256) 262400 activation_34[0][0] \n",
683 "__________________________________________________________________________________________________\n",
684 "bn4e_branch2a (BatchNormalizati (None, 14, 14, 256) 1024 res4e_branch2a[0][0] \n",
685 "__________________________________________________________________________________________________\n",
686 "activation_35 (Activation) (None, 14, 14, 256) 0 bn4e_branch2a[0][0] \n",
687 "__________________________________________________________________________________________________\n",
688 "res4e_branch2b (Conv2D) (None, 14, 14, 256) 590080 activation_35[0][0] \n",
689 "__________________________________________________________________________________________________\n",
690 "bn4e_branch2b (BatchNormalizati (None, 14, 14, 256) 1024 res4e_branch2b[0][0] \n",
691 "__________________________________________________________________________________________________\n",
692 "activation_36 (Activation) (None, 14, 14, 256) 0 bn4e_branch2b[0][0] \n",
693 "__________________________________________________________________________________________________\n",
694 "res4e_branch2c (Conv2D) (None, 14, 14, 1024) 263168 activation_36[0][0] \n",
695 "__________________________________________________________________________________________________\n",
696 "bn4e_branch2c (BatchNormalizati (None, 14, 14, 1024) 4096 res4e_branch2c[0][0] \n",
697 "__________________________________________________________________________________________________\n",
698 "add_12 (Add) (None, 14, 14, 1024) 0 bn4e_branch2c[0][0] \n",
699 " activation_34[0][0] \n",
700 "__________________________________________________________________________________________________\n",
701 "activation_37 (Activation) (None, 14, 14, 1024) 0 add_12[0][0] \n",
702 "__________________________________________________________________________________________________\n",
703 "res4f_branch2a (Conv2D) (None, 14, 14, 256) 262400 activation_37[0][0] \n",
704 "__________________________________________________________________________________________________\n",
705 "bn4f_branch2a (BatchNormalizati (None, 14, 14, 256) 1024 res4f_branch2a[0][0] \n",
706 "__________________________________________________________________________________________________\n",
707 "activation_38 (Activation) (None, 14, 14, 256) 0 bn4f_branch2a[0][0] \n",
708 "__________________________________________________________________________________________________\n",
709 "res4f_branch2b (Conv2D) (None, 14, 14, 256) 590080 activation_38[0][0] \n",
710 "__________________________________________________________________________________________________\n",
711 "bn4f_branch2b (BatchNormalizati (None, 14, 14, 256) 1024 res4f_branch2b[0][0] \n",
712 "__________________________________________________________________________________________________\n",
713 "activation_39 (Activation) (None, 14, 14, 256) 0 bn4f_branch2b[0][0] \n",
714 "__________________________________________________________________________________________________\n",
715 "res4f_branch2c (Conv2D) (None, 14, 14, 1024) 263168 activation_39[0][0] \n",
716 "__________________________________________________________________________________________________\n",
717 "bn4f_branch2c (BatchNormalizati (None, 14, 14, 1024) 4096 res4f_branch2c[0][0] \n",
718 "__________________________________________________________________________________________________\n",
719 "add_13 (Add) (None, 14, 14, 1024) 0 bn4f_branch2c[0][0] \n",
720 " activation_37[0][0] \n",
721 "__________________________________________________________________________________________________\n",
722 "activation_40 (Activation) (None, 14, 14, 1024) 0 add_13[0][0] \n",
723 "__________________________________________________________________________________________________\n",
724 "res5a_branch2a (Conv2D) (None, 7, 7, 512) 524800 activation_40[0][0] \n",
725 "__________________________________________________________________________________________________\n",
726 "bn5a_branch2a (BatchNormalizati (None, 7, 7, 512) 2048 res5a_branch2a[0][0] \n",
727 "__________________________________________________________________________________________________\n",
728 "activation_41 (Activation) (None, 7, 7, 512) 0 bn5a_branch2a[0][0] \n",
729 "__________________________________________________________________________________________________\n",
730 "res5a_branch2b (Conv2D) (None, 7, 7, 512) 2359808 activation_41[0][0] \n",
731 "__________________________________________________________________________________________________\n",
732 "bn5a_branch2b (BatchNormalizati (None, 7, 7, 512) 2048 res5a_branch2b[0][0] \n",
733 "__________________________________________________________________________________________________\n",
734 "activation_42 (Activation) (None, 7, 7, 512) 0 bn5a_branch2b[0][0] \n",
735 "__________________________________________________________________________________________________\n",
736 "res5a_branch2c (Conv2D) (None, 7, 7, 2048) 1050624 activation_42[0][0] \n",
737 "__________________________________________________________________________________________________\n",
738 "res5a_branch1 (Conv2D) (None, 7, 7, 2048) 2099200 activation_40[0][0] \n",
739 "__________________________________________________________________________________________________\n",
740 "bn5a_branch2c (BatchNormalizati (None, 7, 7, 2048) 8192 res5a_branch2c[0][0] \n",
741 "__________________________________________________________________________________________________\n",
742 "bn5a_branch1 (BatchNormalizatio (None, 7, 7, 2048) 8192 res5a_branch1[0][0] \n",
743 "__________________________________________________________________________________________________\n",
744 "add_14 (Add) (None, 7, 7, 2048) 0 bn5a_branch2c[0][0] \n",
745 " bn5a_branch1[0][0] \n",
746 "__________________________________________________________________________________________________\n",
747 "activation_43 (Activation) (None, 7, 7, 2048) 0 add_14[0][0] \n",
748 "__________________________________________________________________________________________________\n",
749 "res5b_branch2a (Conv2D) (None, 7, 7, 512) 1049088 activation_43[0][0] \n",
750 "__________________________________________________________________________________________________\n",
751 "bn5b_branch2a (BatchNormalizati (None, 7, 7, 512) 2048 res5b_branch2a[0][0] \n",
752 "__________________________________________________________________________________________________\n",
753 "activation_44 (Activation) (None, 7, 7, 512) 0 bn5b_branch2a[0][0] \n",
754 "__________________________________________________________________________________________________\n",
755 "res5b_branch2b (Conv2D) (None, 7, 7, 512) 2359808 activation_44[0][0] \n",
756 "__________________________________________________________________________________________________\n",
757 "bn5b_branch2b (BatchNormalizati (None, 7, 7, 512) 2048 res5b_branch2b[0][0] \n",
758 "__________________________________________________________________________________________________\n",
759 "activation_45 (Activation) (None, 7, 7, 512) 0 bn5b_branch2b[0][0] \n",
760 "__________________________________________________________________________________________________\n",
761 "res5b_branch2c (Conv2D) (None, 7, 7, 2048) 1050624 activation_45[0][0] \n",
762 "__________________________________________________________________________________________________\n",
763 "bn5b_branch2c (BatchNormalizati (None, 7, 7, 2048) 8192 res5b_branch2c[0][0] \n",
764 "__________________________________________________________________________________________________\n",
765 "add_15 (Add) (None, 7, 7, 2048) 0 bn5b_branch2c[0][0] \n",
766 " activation_43[0][0] \n",
767 "__________________________________________________________________________________________________\n",
768 "activation_46 (Activation) (None, 7, 7, 2048) 0 add_15[0][0] \n",
769 "__________________________________________________________________________________________________\n",
770 "res5c_branch2a (Conv2D) (None, 7, 7, 512) 1049088 activation_46[0][0] \n",
771 "__________________________________________________________________________________________________\n",
772 "bn5c_branch2a (BatchNormalizati (None, 7, 7, 512) 2048 res5c_branch2a[0][0] \n",
773 "__________________________________________________________________________________________________\n",
774 "activation_47 (Activation) (None, 7, 7, 512) 0 bn5c_branch2a[0][0] \n",
775 "__________________________________________________________________________________________________\n",
776 "res5c_branch2b (Conv2D) (None, 7, 7, 512) 2359808 activation_47[0][0] \n",
777 "__________________________________________________________________________________________________\n",
778 "bn5c_branch2b (BatchNormalizati (None, 7, 7, 512) 2048 res5c_branch2b[0][0] \n",
779 "__________________________________________________________________________________________________\n",
780 "activation_48 (Activation) (None, 7, 7, 512) 0 bn5c_branch2b[0][0] \n",
781 "__________________________________________________________________________________________________\n",
782 "res5c_branch2c (Conv2D) (None, 7, 7, 2048) 1050624 activation_48[0][0] \n",
783 "__________________________________________________________________________________________________\n",
784 "bn5c_branch2c (BatchNormalizati (None, 7, 7, 2048) 8192 res5c_branch2c[0][0] \n",
785 "__________________________________________________________________________________________________\n",
786 "add_16 (Add) (None, 7, 7, 2048) 0 bn5c_branch2c[0][0] \n",
787 " activation_46[0][0] \n",
788 "__________________________________________________________________________________________________\n",
789 "activation_49 (Activation) (None, 7, 7, 2048) 0 add_16[0][0] \n",
790 "__________________________________________________________________________________________________\n",
791 "avg_pool (GlobalAveragePooling2 (None, 2048) 0 activation_49[0][0] \n",
792 "__________________________________________________________________________________________________\n",
793 "fc1000 (Dense) (None, 1000) 2049000 avg_pool[0][0] \n",
794 "==================================================================================================\n",
795 "Total params: 25,636,712\n",
796 "Trainable params: 25,583,592\n",
797 "Non-trainable params: 53,120\n",
798 "__________________________________________________________________________________________________\n"
799 ]
800 }
801 ],
802 "source": [
803 "resnet = ResNet50()\n",
804 "resnet.summary()"
805 ]
806 },
807 {
808 "cell_type": "markdown",
809 "metadata": {},
810 "source": [
811 "### Without final layer"
812 ]
813 },
814 {
815 "cell_type": "code",
816 "execution_count": 22,
817 "metadata": {
818 "ExecuteTime": {
819 "end_time": "2017-06-06T01:49:06.604819Z",
820 "start_time": "2017-06-06T01:48:32.840764Z"
821 },
822 "scrolled": false
823 },
824 "outputs": [
825 {
826 "name": "stderr",
827 "output_type": "stream",
828 "text": [
829 "/home/stefan/.pyenv/versions/miniconda3-latest/envs/ml4t/lib/python3.6/site-packages/keras_applications/resnet50.py:265: UserWarning: The output shape of `ResNet50(include_top=False)` has been changed since Keras 2.2.0.\n",
830 " warnings.warn('The output shape of `ResNet50(include_top=False)` '\n"
831 ]
832 },
833 {
834 "name": "stdout",
835 "output_type": "stream",
836 "text": [
837 "Downloading data from https://github.com/fchollet/deep-learning-models/releases/download/v0.2/resnet50_weights_tf_dim_ordering_tf_kernels_notop.h5\n",
838 "94658560/94653016 [==============================] - 5s 0us/step\n",
839 "__________________________________________________________________________________________________\n",
840 "Layer (type) Output Shape Param # Connected to \n",
841 "==================================================================================================\n",
842 "input_4 (InputLayer) (None, None, None, 3 0 \n",
843 "__________________________________________________________________________________________________\n",
844 "conv1_pad (ZeroPadding2D) (None, None, None, 3 0 input_4[0][0] \n",
845 "__________________________________________________________________________________________________\n",
846 "conv1 (Conv2D) (None, None, None, 6 9472 conv1_pad[0][0] \n",
847 "__________________________________________________________________________________________________\n",
848 "bn_conv1 (BatchNormalization) (None, None, None, 6 256 conv1[0][0] \n",
849 "__________________________________________________________________________________________________\n",
850 "activation_50 (Activation) (None, None, None, 6 0 bn_conv1[0][0] \n",
851 "__________________________________________________________________________________________________\n",
852 "pool1_pad (ZeroPadding2D) (None, None, None, 6 0 activation_50[0][0] \n",
853 "__________________________________________________________________________________________________\n",
854 "max_pooling2d_2 (MaxPooling2D) (None, None, None, 6 0 pool1_pad[0][0] \n",
855 "__________________________________________________________________________________________________\n",
856 "res2a_branch2a (Conv2D) (None, None, None, 6 4160 max_pooling2d_2[0][0] \n",
857 "__________________________________________________________________________________________________\n",
858 "bn2a_branch2a (BatchNormalizati (None, None, None, 6 256 res2a_branch2a[0][0] \n",
859 "__________________________________________________________________________________________________\n",
860 "activation_51 (Activation) (None, None, None, 6 0 bn2a_branch2a[0][0] \n",
861 "__________________________________________________________________________________________________\n",
862 "res2a_branch2b (Conv2D) (None, None, None, 6 36928 activation_51[0][0] \n",
863 "__________________________________________________________________________________________________\n",
864 "bn2a_branch2b (BatchNormalizati (None, None, None, 6 256 res2a_branch2b[0][0] \n",
865 "__________________________________________________________________________________________________\n",
866 "activation_52 (Activation) (None, None, None, 6 0 bn2a_branch2b[0][0] \n",
867 "__________________________________________________________________________________________________\n",
868 "res2a_branch2c (Conv2D) (None, None, None, 2 16640 activation_52[0][0] \n",
869 "__________________________________________________________________________________________________\n",
870 "res2a_branch1 (Conv2D) (None, None, None, 2 16640 max_pooling2d_2[0][0] \n",
871 "__________________________________________________________________________________________________\n",
872 "bn2a_branch2c (BatchNormalizati (None, None, None, 2 1024 res2a_branch2c[0][0] \n",
873 "__________________________________________________________________________________________________\n",
874 "bn2a_branch1 (BatchNormalizatio (None, None, None, 2 1024 res2a_branch1[0][0] \n",
875 "__________________________________________________________________________________________________\n",
876 "add_17 (Add) (None, None, None, 2 0 bn2a_branch2c[0][0] \n",
877 " bn2a_branch1[0][0] \n",
878 "__________________________________________________________________________________________________\n",
879 "activation_53 (Activation) (None, None, None, 2 0 add_17[0][0] \n",
880 "__________________________________________________________________________________________________\n",
881 "res2b_branch2a (Conv2D) (None, None, None, 6 16448 activation_53[0][0] \n",
882 "__________________________________________________________________________________________________\n",
883 "bn2b_branch2a (BatchNormalizati (None, None, None, 6 256 res2b_branch2a[0][0] \n",
884 "__________________________________________________________________________________________________\n",
885 "activation_54 (Activation) (None, None, None, 6 0 bn2b_branch2a[0][0] \n",
886 "__________________________________________________________________________________________________\n",
887 "res2b_branch2b (Conv2D) (None, None, None, 6 36928 activation_54[0][0] \n",
888 "__________________________________________________________________________________________________\n",
889 "bn2b_branch2b (BatchNormalizati (None, None, None, 6 256 res2b_branch2b[0][0] \n",
890 "__________________________________________________________________________________________________\n",
891 "activation_55 (Activation) (None, None, None, 6 0 bn2b_branch2b[0][0] \n",
892 "__________________________________________________________________________________________________\n",
893 "res2b_branch2c (Conv2D) (None, None, None, 2 16640 activation_55[0][0] \n",
894 "__________________________________________________________________________________________________\n",
895 "bn2b_branch2c (BatchNormalizati (None, None, None, 2 1024 res2b_branch2c[0][0] \n",
896 "__________________________________________________________________________________________________\n",
897 "add_18 (Add) (None, None, None, 2 0 bn2b_branch2c[0][0] \n",
898 " activation_53[0][0] \n",
899 "__________________________________________________________________________________________________\n",
900 "activation_56 (Activation) (None, None, None, 2 0 add_18[0][0] \n",
901 "__________________________________________________________________________________________________\n",
902 "res2c_branch2a (Conv2D) (None, None, None, 6 16448 activation_56[0][0] \n",
903 "__________________________________________________________________________________________________\n",
904 "bn2c_branch2a (BatchNormalizati (None, None, None, 6 256 res2c_branch2a[0][0] \n",
905 "__________________________________________________________________________________________________\n",
906 "activation_57 (Activation) (None, None, None, 6 0 bn2c_branch2a[0][0] \n",
907 "__________________________________________________________________________________________________\n",
908 "res2c_branch2b (Conv2D) (None, None, None, 6 36928 activation_57[0][0] \n",
909 "__________________________________________________________________________________________________\n",
910 "bn2c_branch2b (BatchNormalizati (None, None, None, 6 256 res2c_branch2b[0][0] \n",
911 "__________________________________________________________________________________________________\n",
912 "activation_58 (Activation) (None, None, None, 6 0 bn2c_branch2b[0][0] \n",
913 "__________________________________________________________________________________________________\n",
914 "res2c_branch2c (Conv2D) (None, None, None, 2 16640 activation_58[0][0] \n",
915 "__________________________________________________________________________________________________\n",
916 "bn2c_branch2c (BatchNormalizati (None, None, None, 2 1024 res2c_branch2c[0][0] \n",
917 "__________________________________________________________________________________________________\n",
918 "add_19 (Add) (None, None, None, 2 0 bn2c_branch2c[0][0] \n",
919 " activation_56[0][0] \n",
920 "__________________________________________________________________________________________________\n",
921 "activation_59 (Activation) (None, None, None, 2 0 add_19[0][0] \n",
922 "__________________________________________________________________________________________________\n",
923 "res3a_branch2a (Conv2D) (None, None, None, 1 32896 activation_59[0][0] \n",
924 "__________________________________________________________________________________________________\n",
925 "bn3a_branch2a (BatchNormalizati (None, None, None, 1 512 res3a_branch2a[0][0] \n",
926 "__________________________________________________________________________________________________\n",
927 "activation_60 (Activation) (None, None, None, 1 0 bn3a_branch2a[0][0] \n",
928 "__________________________________________________________________________________________________\n",
929 "res3a_branch2b (Conv2D) (None, None, None, 1 147584 activation_60[0][0] \n",
930 "__________________________________________________________________________________________________\n",
931 "bn3a_branch2b (BatchNormalizati (None, None, None, 1 512 res3a_branch2b[0][0] \n",
932 "__________________________________________________________________________________________________\n",
933 "activation_61 (Activation) (None, None, None, 1 0 bn3a_branch2b[0][0] \n",
934 "__________________________________________________________________________________________________\n",
935 "res3a_branch2c (Conv2D) (None, None, None, 5 66048 activation_61[0][0] \n",
936 "__________________________________________________________________________________________________\n",
937 "res3a_branch1 (Conv2D) (None, None, None, 5 131584 activation_59[0][0] \n",
938 "__________________________________________________________________________________________________\n",
939 "bn3a_branch2c (BatchNormalizati (None, None, None, 5 2048 res3a_branch2c[0][0] \n",
940 "__________________________________________________________________________________________________\n",
941 "bn3a_branch1 (BatchNormalizatio (None, None, None, 5 2048 res3a_branch1[0][0] \n",
942 "__________________________________________________________________________________________________\n",
943 "add_20 (Add) (None, None, None, 5 0 bn3a_branch2c[0][0] \n",
944 " bn3a_branch1[0][0] \n",
945 "__________________________________________________________________________________________________\n",
946 "activation_62 (Activation) (None, None, None, 5 0 add_20[0][0] \n",
947 "__________________________________________________________________________________________________\n",
948 "res3b_branch2a (Conv2D) (None, None, None, 1 65664 activation_62[0][0] \n",
949 "__________________________________________________________________________________________________\n",
950 "bn3b_branch2a (BatchNormalizati (None, None, None, 1 512 res3b_branch2a[0][0] \n",
951 "__________________________________________________________________________________________________\n",
952 "activation_63 (Activation) (None, None, None, 1 0 bn3b_branch2a[0][0] \n",
953 "__________________________________________________________________________________________________\n",
954 "res3b_branch2b (Conv2D) (None, None, None, 1 147584 activation_63[0][0] \n",
955 "__________________________________________________________________________________________________\n",
956 "bn3b_branch2b (BatchNormalizati (None, None, None, 1 512 res3b_branch2b[0][0] \n",
957 "__________________________________________________________________________________________________\n",
958 "activation_64 (Activation) (None, None, None, 1 0 bn3b_branch2b[0][0] \n",
959 "__________________________________________________________________________________________________\n",
960 "res3b_branch2c (Conv2D) (None, None, None, 5 66048 activation_64[0][0] \n",
961 "__________________________________________________________________________________________________\n",
962 "bn3b_branch2c (BatchNormalizati (None, None, None, 5 2048 res3b_branch2c[0][0] \n",
963 "__________________________________________________________________________________________________\n",
964 "add_21 (Add) (None, None, None, 5 0 bn3b_branch2c[0][0] \n",
965 " activation_62[0][0] \n",
966 "__________________________________________________________________________________________________\n",
967 "activation_65 (Activation) (None, None, None, 5 0 add_21[0][0] \n",
968 "__________________________________________________________________________________________________\n",
969 "res3c_branch2a (Conv2D) (None, None, None, 1 65664 activation_65[0][0] \n",
970 "__________________________________________________________________________________________________\n",
971 "bn3c_branch2a (BatchNormalizati (None, None, None, 1 512 res3c_branch2a[0][0] \n",
972 "__________________________________________________________________________________________________\n",
973 "activation_66 (Activation) (None, None, None, 1 0 bn3c_branch2a[0][0] \n",
974 "__________________________________________________________________________________________________\n",
975 "res3c_branch2b (Conv2D) (None, None, None, 1 147584 activation_66[0][0] \n",
976 "__________________________________________________________________________________________________\n",
977 "bn3c_branch2b (BatchNormalizati (None, None, None, 1 512 res3c_branch2b[0][0] \n",
978 "__________________________________________________________________________________________________\n",
979 "activation_67 (Activation) (None, None, None, 1 0 bn3c_branch2b[0][0] \n",
980 "__________________________________________________________________________________________________\n",
981 "res3c_branch2c (Conv2D) (None, None, None, 5 66048 activation_67[0][0] \n",
982 "__________________________________________________________________________________________________\n",
983 "bn3c_branch2c (BatchNormalizati (None, None, None, 5 2048 res3c_branch2c[0][0] \n",
984 "__________________________________________________________________________________________________\n",
985 "add_22 (Add) (None, None, None, 5 0 bn3c_branch2c[0][0] \n",
986 " activation_65[0][0] \n",
987 "__________________________________________________________________________________________________\n",
988 "activation_68 (Activation) (None, None, None, 5 0 add_22[0][0] \n",
989 "__________________________________________________________________________________________________\n",
990 "res3d_branch2a (Conv2D) (None, None, None, 1 65664 activation_68[0][0] \n",
991 "__________________________________________________________________________________________________\n",
992 "bn3d_branch2a (BatchNormalizati (None, None, None, 1 512 res3d_branch2a[0][0] \n",
993 "__________________________________________________________________________________________________\n",
994 "activation_69 (Activation) (None, None, None, 1 0 bn3d_branch2a[0][0] \n",
995 "__________________________________________________________________________________________________\n",
996 "res3d_branch2b (Conv2D) (None, None, None, 1 147584 activation_69[0][0] \n",
997 "__________________________________________________________________________________________________\n",
998 "bn3d_branch2b (BatchNormalizati (None, None, None, 1 512 res3d_branch2b[0][0] \n",
999 "__________________________________________________________________________________________________\n",
1000 "activation_70 (Activation) (None, None, None, 1 0 bn3d_branch2b[0][0] \n",
1001 "__________________________________________________________________________________________________\n",
1002 "res3d_branch2c (Conv2D) (None, None, None, 5 66048 activation_70[0][0] \n",
1003 "__________________________________________________________________________________________________\n",
1004 "bn3d_branch2c (BatchNormalizati (None, None, None, 5 2048 res3d_branch2c[0][0] \n",
1005 "__________________________________________________________________________________________________\n",
1006 "add_23 (Add) (None, None, None, 5 0 bn3d_branch2c[0][0] \n",
1007 " activation_68[0][0] \n",
1008 "__________________________________________________________________________________________________\n",
1009 "activation_71 (Activation) (None, None, None, 5 0 add_23[0][0] \n",
1010 "__________________________________________________________________________________________________\n",
1011 "res4a_branch2a (Conv2D) (None, None, None, 2 131328 activation_71[0][0] \n",
1012 "__________________________________________________________________________________________________\n",
1013 "bn4a_branch2a (BatchNormalizati (None, None, None, 2 1024 res4a_branch2a[0][0] \n",
1014 "__________________________________________________________________________________________________\n",
1015 "activation_72 (Activation) (None, None, None, 2 0 bn4a_branch2a[0][0] \n",
1016 "__________________________________________________________________________________________________\n",
1017 "res4a_branch2b (Conv2D) (None, None, None, 2 590080 activation_72[0][0] \n",
1018 "__________________________________________________________________________________________________\n",
1019 "bn4a_branch2b (BatchNormalizati (None, None, None, 2 1024 res4a_branch2b[0][0] \n",
1020 "__________________________________________________________________________________________________\n",
1021 "activation_73 (Activation) (None, None, None, 2 0 bn4a_branch2b[0][0] \n",
1022 "__________________________________________________________________________________________________\n",
1023 "res4a_branch2c (Conv2D) (None, None, None, 1 263168 activation_73[0][0] \n",
1024 "__________________________________________________________________________________________________\n",
1025 "res4a_branch1 (Conv2D) (None, None, None, 1 525312 activation_71[0][0] \n",
1026 "__________________________________________________________________________________________________\n",
1027 "bn4a_branch2c (BatchNormalizati (None, None, None, 1 4096 res4a_branch2c[0][0] \n",
1028 "__________________________________________________________________________________________________\n",
1029 "bn4a_branch1 (BatchNormalizatio (None, None, None, 1 4096 res4a_branch1[0][0] \n",
1030 "__________________________________________________________________________________________________\n",
1031 "add_24 (Add) (None, None, None, 1 0 bn4a_branch2c[0][0] \n",
1032 " bn4a_branch1[0][0] \n",
1033 "__________________________________________________________________________________________________\n",
1034 "activation_74 (Activation) (None, None, None, 1 0 add_24[0][0] \n",
1035 "__________________________________________________________________________________________________\n",
1036 "res4b_branch2a (Conv2D) (None, None, None, 2 262400 activation_74[0][0] \n",
1037 "__________________________________________________________________________________________________\n",
1038 "bn4b_branch2a (BatchNormalizati (None, None, None, 2 1024 res4b_branch2a[0][0] \n",
1039 "__________________________________________________________________________________________________\n",
1040 "activation_75 (Activation) (None, None, None, 2 0 bn4b_branch2a[0][0] \n",
1041 "__________________________________________________________________________________________________\n",
1042 "res4b_branch2b (Conv2D) (None, None, None, 2 590080 activation_75[0][0] \n",
1043 "__________________________________________________________________________________________________\n",
1044 "bn4b_branch2b (BatchNormalizati (None, None, None, 2 1024 res4b_branch2b[0][0] \n",
1045 "__________________________________________________________________________________________________\n",
1046 "activation_76 (Activation) (None, None, None, 2 0 bn4b_branch2b[0][0] \n",
1047 "__________________________________________________________________________________________________\n",
1048 "res4b_branch2c (Conv2D) (None, None, None, 1 263168 activation_76[0][0] \n",
1049 "__________________________________________________________________________________________________\n",
1050 "bn4b_branch2c (BatchNormalizati (None, None, None, 1 4096 res4b_branch2c[0][0] \n",
1051 "__________________________________________________________________________________________________\n",
1052 "add_25 (Add) (None, None, None, 1 0 bn4b_branch2c[0][0] \n",
1053 " activation_74[0][0] \n",
1054 "__________________________________________________________________________________________________\n",
1055 "activation_77 (Activation) (None, None, None, 1 0 add_25[0][0] \n",
1056 "__________________________________________________________________________________________________\n",
1057 "res4c_branch2a (Conv2D) (None, None, None, 2 262400 activation_77[0][0] \n",
1058 "__________________________________________________________________________________________________\n",
1059 "bn4c_branch2a (BatchNormalizati (None, None, None, 2 1024 res4c_branch2a[0][0] \n",
1060 "__________________________________________________________________________________________________\n",
1061 "activation_78 (Activation) (None, None, None, 2 0 bn4c_branch2a[0][0] \n",
1062 "__________________________________________________________________________________________________\n",
1063 "res4c_branch2b (Conv2D) (None, None, None, 2 590080 activation_78[0][0] \n",
1064 "__________________________________________________________________________________________________\n",
1065 "bn4c_branch2b (BatchNormalizati (None, None, None, 2 1024 res4c_branch2b[0][0] \n",
1066 "__________________________________________________________________________________________________\n",
1067 "activation_79 (Activation) (None, None, None, 2 0 bn4c_branch2b[0][0] \n",
1068 "__________________________________________________________________________________________________\n",
1069 "res4c_branch2c (Conv2D) (None, None, None, 1 263168 activation_79[0][0] \n",
1070 "__________________________________________________________________________________________________\n",
1071 "bn4c_branch2c (BatchNormalizati (None, None, None, 1 4096 res4c_branch2c[0][0] \n",
1072 "__________________________________________________________________________________________________\n",
1073 "add_26 (Add) (None, None, None, 1 0 bn4c_branch2c[0][0] \n",
1074 " activation_77[0][0] \n",
1075 "__________________________________________________________________________________________________\n",
1076 "activation_80 (Activation) (None, None, None, 1 0 add_26[0][0] \n",
1077 "__________________________________________________________________________________________________\n",
1078 "res4d_branch2a (Conv2D) (None, None, None, 2 262400 activation_80[0][0] \n",
1079 "__________________________________________________________________________________________________\n",
1080 "bn4d_branch2a (BatchNormalizati (None, None, None, 2 1024 res4d_branch2a[0][0] \n",
1081 "__________________________________________________________________________________________________\n",
1082 "activation_81 (Activation) (None, None, None, 2 0 bn4d_branch2a[0][0] \n",
1083 "__________________________________________________________________________________________________\n",
1084 "res4d_branch2b (Conv2D) (None, None, None, 2 590080 activation_81[0][0] \n",
1085 "__________________________________________________________________________________________________\n",
1086 "bn4d_branch2b (BatchNormalizati (None, None, None, 2 1024 res4d_branch2b[0][0] \n",
1087 "__________________________________________________________________________________________________\n",
1088 "activation_82 (Activation) (None, None, None, 2 0 bn4d_branch2b[0][0] \n",
1089 "__________________________________________________________________________________________________\n",
1090 "res4d_branch2c (Conv2D) (None, None, None, 1 263168 activation_82[0][0] \n",
1091 "__________________________________________________________________________________________________\n",
1092 "bn4d_branch2c (BatchNormalizati (None, None, None, 1 4096 res4d_branch2c[0][0] \n",
1093 "__________________________________________________________________________________________________\n",
1094 "add_27 (Add) (None, None, None, 1 0 bn4d_branch2c[0][0] \n",
1095 " activation_80[0][0] \n",
1096 "__________________________________________________________________________________________________\n",
1097 "activation_83 (Activation) (None, None, None, 1 0 add_27[0][0] \n",
1098 "__________________________________________________________________________________________________\n",
1099 "res4e_branch2a (Conv2D) (None, None, None, 2 262400 activation_83[0][0] \n",
1100 "__________________________________________________________________________________________________\n",
1101 "bn4e_branch2a (BatchNormalizati (None, None, None, 2 1024 res4e_branch2a[0][0] \n",
1102 "__________________________________________________________________________________________________\n",
1103 "activation_84 (Activation) (None, None, None, 2 0 bn4e_branch2a[0][0] \n",
1104 "__________________________________________________________________________________________________\n",
1105 "res4e_branch2b (Conv2D) (None, None, None, 2 590080 activation_84[0][0] \n",
1106 "__________________________________________________________________________________________________\n",
1107 "bn4e_branch2b (BatchNormalizati (None, None, None, 2 1024 res4e_branch2b[0][0] \n",
1108 "__________________________________________________________________________________________________\n",
1109 "activation_85 (Activation) (None, None, None, 2 0 bn4e_branch2b[0][0] \n",
1110 "__________________________________________________________________________________________________\n",
1111 "res4e_branch2c (Conv2D) (None, None, None, 1 263168 activation_85[0][0] \n",
1112 "__________________________________________________________________________________________________\n",
1113 "bn4e_branch2c (BatchNormalizati (None, None, None, 1 4096 res4e_branch2c[0][0] \n",
1114 "__________________________________________________________________________________________________\n",
1115 "add_28 (Add) (None, None, None, 1 0 bn4e_branch2c[0][0] \n",
1116 " activation_83[0][0] \n",
1117 "__________________________________________________________________________________________________\n",
1118 "activation_86 (Activation) (None, None, None, 1 0 add_28[0][0] \n",
1119 "__________________________________________________________________________________________________\n",
1120 "res4f_branch2a (Conv2D) (None, None, None, 2 262400 activation_86[0][0] \n",
1121 "__________________________________________________________________________________________________\n",
1122 "bn4f_branch2a (BatchNormalizati (None, None, None, 2 1024 res4f_branch2a[0][0] \n",
1123 "__________________________________________________________________________________________________\n",
1124 "activation_87 (Activation) (None, None, None, 2 0 bn4f_branch2a[0][0] \n",
1125 "__________________________________________________________________________________________________\n",
1126 "res4f_branch2b (Conv2D) (None, None, None, 2 590080 activation_87[0][0] \n",
1127 "__________________________________________________________________________________________________\n",
1128 "bn4f_branch2b (BatchNormalizati (None, None, None, 2 1024 res4f_branch2b[0][0] \n",
1129 "__________________________________________________________________________________________________\n",
1130 "activation_88 (Activation) (None, None, None, 2 0 bn4f_branch2b[0][0] \n",
1131 "__________________________________________________________________________________________________\n",
1132 "res4f_branch2c (Conv2D) (None, None, None, 1 263168 activation_88[0][0] \n",
1133 "__________________________________________________________________________________________________\n",
1134 "bn4f_branch2c (BatchNormalizati (None, None, None, 1 4096 res4f_branch2c[0][0] \n",
1135 "__________________________________________________________________________________________________\n",
1136 "add_29 (Add) (None, None, None, 1 0 bn4f_branch2c[0][0] \n",
1137 " activation_86[0][0] \n",
1138 "__________________________________________________________________________________________________\n",
1139 "activation_89 (Activation) (None, None, None, 1 0 add_29[0][0] \n",
1140 "__________________________________________________________________________________________________\n",
1141 "res5a_branch2a (Conv2D) (None, None, None, 5 524800 activation_89[0][0] \n",
1142 "__________________________________________________________________________________________________\n",
1143 "bn5a_branch2a (BatchNormalizati (None, None, None, 5 2048 res5a_branch2a[0][0] \n",
1144 "__________________________________________________________________________________________________\n",
1145 "activation_90 (Activation) (None, None, None, 5 0 bn5a_branch2a[0][0] \n",
1146 "__________________________________________________________________________________________________\n",
1147 "res5a_branch2b (Conv2D) (None, None, None, 5 2359808 activation_90[0][0] \n",
1148 "__________________________________________________________________________________________________\n",
1149 "bn5a_branch2b (BatchNormalizati (None, None, None, 5 2048 res5a_branch2b[0][0] \n",
1150 "__________________________________________________________________________________________________\n",
1151 "activation_91 (Activation) (None, None, None, 5 0 bn5a_branch2b[0][0] \n",
1152 "__________________________________________________________________________________________________\n",
1153 "res5a_branch2c (Conv2D) (None, None, None, 2 1050624 activation_91[0][0] \n",
1154 "__________________________________________________________________________________________________\n",
1155 "res5a_branch1 (Conv2D) (None, None, None, 2 2099200 activation_89[0][0] \n",
1156 "__________________________________________________________________________________________________\n",
1157 "bn5a_branch2c (BatchNormalizati (None, None, None, 2 8192 res5a_branch2c[0][0] \n",
1158 "__________________________________________________________________________________________________\n",
1159 "bn5a_branch1 (BatchNormalizatio (None, None, None, 2 8192 res5a_branch1[0][0] \n",
1160 "__________________________________________________________________________________________________\n",
1161 "add_30 (Add) (None, None, None, 2 0 bn5a_branch2c[0][0] \n",
1162 " bn5a_branch1[0][0] \n",
1163 "__________________________________________________________________________________________________\n",
1164 "activation_92 (Activation) (None, None, None, 2 0 add_30[0][0] \n",
1165 "__________________________________________________________________________________________________\n",
1166 "res5b_branch2a (Conv2D) (None, None, None, 5 1049088 activation_92[0][0] \n",
1167 "__________________________________________________________________________________________________\n",
1168 "bn5b_branch2a (BatchNormalizati (None, None, None, 5 2048 res5b_branch2a[0][0] \n",
1169 "__________________________________________________________________________________________________\n",
1170 "activation_93 (Activation) (None, None, None, 5 0 bn5b_branch2a[0][0] \n",
1171 "__________________________________________________________________________________________________\n",
1172 "res5b_branch2b (Conv2D) (None, None, None, 5 2359808 activation_93[0][0] \n",
1173 "__________________________________________________________________________________________________\n",
1174 "bn5b_branch2b (BatchNormalizati (None, None, None, 5 2048 res5b_branch2b[0][0] \n",
1175 "__________________________________________________________________________________________________\n",
1176 "activation_94 (Activation) (None, None, None, 5 0 bn5b_branch2b[0][0] \n",
1177 "__________________________________________________________________________________________________\n",
1178 "res5b_branch2c (Conv2D) (None, None, None, 2 1050624 activation_94[0][0] \n",
1179 "__________________________________________________________________________________________________\n",
1180 "bn5b_branch2c (BatchNormalizati (None, None, None, 2 8192 res5b_branch2c[0][0] \n",
1181 "__________________________________________________________________________________________________\n",
1182 "add_31 (Add) (None, None, None, 2 0 bn5b_branch2c[0][0] \n",
1183 " activation_92[0][0] \n",
1184 "__________________________________________________________________________________________________\n",
1185 "activation_95 (Activation) (None, None, None, 2 0 add_31[0][0] \n",
1186 "__________________________________________________________________________________________________\n",
1187 "res5c_branch2a (Conv2D) (None, None, None, 5 1049088 activation_95[0][0] \n",
1188 "__________________________________________________________________________________________________\n",
1189 "bn5c_branch2a (BatchNormalizati (None, None, None, 5 2048 res5c_branch2a[0][0] \n",
1190 "__________________________________________________________________________________________________\n",
1191 "activation_96 (Activation) (None, None, None, 5 0 bn5c_branch2a[0][0] \n",
1192 "__________________________________________________________________________________________________\n",
1193 "res5c_branch2b (Conv2D) (None, None, None, 5 2359808 activation_96[0][0] \n",
1194 "__________________________________________________________________________________________________\n",
1195 "bn5c_branch2b (BatchNormalizati (None, None, None, 5 2048 res5c_branch2b[0][0] \n",
1196 "__________________________________________________________________________________________________\n",
1197 "activation_97 (Activation) (None, None, None, 5 0 bn5c_branch2b[0][0] \n",
1198 "__________________________________________________________________________________________________\n",
1199 "res5c_branch2c (Conv2D) (None, None, None, 2 1050624 activation_97[0][0] \n",
1200 "__________________________________________________________________________________________________\n",
1201 "bn5c_branch2c (BatchNormalizati (None, None, None, 2 8192 res5c_branch2c[0][0] \n",
1202 "__________________________________________________________________________________________________\n",
1203 "add_32 (Add) (None, None, None, 2 0 bn5c_branch2c[0][0] \n",
1204 " activation_95[0][0] \n",
1205 "__________________________________________________________________________________________________\n",
1206 "activation_98 (Activation) (None, None, None, 2 0 add_32[0][0] \n",
1207 "==================================================================================================\n",
1208 "Total params: 23,587,712\n",
1209 "Trainable params: 23,534,592\n",
1210 "Non-trainable params: 53,120\n",
1211 "__________________________________________________________________________________________________\n"
1212 ]
1213 }
1214 ],
1215 "source": [
1216 "resnet = ResNet50(include_top=False)\n",
1217 "resnet.summary()"
1218 ]
1219 },
1220 {
1221 "cell_type": "markdown",
1222 "metadata": {},
1223 "source": [
1224 "## Import Inception V3"
1225 ]
1226 },
1227 {
1228 "cell_type": "markdown",
1229 "metadata": {},
1230 "source": [
1231 "### With final layer"
1232 ]
1233 },
1234 {
1235 "cell_type": "code",
1236 "execution_count": 23,
1237 "metadata": {
1238 "ExecuteTime": {
1239 "end_time": "2017-06-06T01:56:32.382703Z",
1240 "start_time": "2017-06-06T01:56:08.263487Z"
1241 }
1242 },
1243 "outputs": [
1244 {
1245 "name": "stdout",
1246 "output_type": "stream",
1247 "text": [
1248 "__________________________________________________________________________________________________\n",
1249 "Layer (type) Output Shape Param # Connected to \n",
1250 "==================================================================================================\n",
1251 "input_5 (InputLayer) (None, 299, 299, 3) 0 \n",
1252 "__________________________________________________________________________________________________\n",
1253 "conv2d_1 (Conv2D) (None, 149, 149, 32) 864 input_5[0][0] \n",
1254 "__________________________________________________________________________________________________\n",
1255 "batch_normalization_1 (BatchNor (None, 149, 149, 32) 96 conv2d_1[0][0] \n",
1256 "__________________________________________________________________________________________________\n",
1257 "activation_99 (Activation) (None, 149, 149, 32) 0 batch_normalization_1[0][0] \n",
1258 "__________________________________________________________________________________________________\n",
1259 "conv2d_2 (Conv2D) (None, 147, 147, 32) 9216 activation_99[0][0] \n",
1260 "__________________________________________________________________________________________________\n",
1261 "batch_normalization_2 (BatchNor (None, 147, 147, 32) 96 conv2d_2[0][0] \n",
1262 "__________________________________________________________________________________________________\n",
1263 "activation_100 (Activation) (None, 147, 147, 32) 0 batch_normalization_2[0][0] \n",
1264 "__________________________________________________________________________________________________\n",
1265 "conv2d_3 (Conv2D) (None, 147, 147, 64) 18432 activation_100[0][0] \n",
1266 "__________________________________________________________________________________________________\n",
1267 "batch_normalization_3 (BatchNor (None, 147, 147, 64) 192 conv2d_3[0][0] \n",
1268 "__________________________________________________________________________________________________\n",
1269 "activation_101 (Activation) (None, 147, 147, 64) 0 batch_normalization_3[0][0] \n",
1270 "__________________________________________________________________________________________________\n",
1271 "max_pooling2d_3 (MaxPooling2D) (None, 73, 73, 64) 0 activation_101[0][0] \n",
1272 "__________________________________________________________________________________________________\n",
1273 "conv2d_4 (Conv2D) (None, 73, 73, 80) 5120 max_pooling2d_3[0][0] \n",
1274 "__________________________________________________________________________________________________\n",
1275 "batch_normalization_4 (BatchNor (None, 73, 73, 80) 240 conv2d_4[0][0] \n",
1276 "__________________________________________________________________________________________________\n",
1277 "activation_102 (Activation) (None, 73, 73, 80) 0 batch_normalization_4[0][0] \n",
1278 "__________________________________________________________________________________________________\n",
1279 "conv2d_5 (Conv2D) (None, 71, 71, 192) 138240 activation_102[0][0] \n",
1280 "__________________________________________________________________________________________________\n",
1281 "batch_normalization_5 (BatchNor (None, 71, 71, 192) 576 conv2d_5[0][0] \n",
1282 "__________________________________________________________________________________________________\n",
1283 "activation_103 (Activation) (None, 71, 71, 192) 0 batch_normalization_5[0][0] \n",
1284 "__________________________________________________________________________________________________\n",
1285 "max_pooling2d_4 (MaxPooling2D) (None, 35, 35, 192) 0 activation_103[0][0] \n",
1286 "__________________________________________________________________________________________________\n",
1287 "conv2d_9 (Conv2D) (None, 35, 35, 64) 12288 max_pooling2d_4[0][0] \n",
1288 "__________________________________________________________________________________________________\n",
1289 "batch_normalization_9 (BatchNor (None, 35, 35, 64) 192 conv2d_9[0][0] \n",
1290 "__________________________________________________________________________________________________\n",
1291 "activation_107 (Activation) (None, 35, 35, 64) 0 batch_normalization_9[0][0] \n",
1292 "__________________________________________________________________________________________________\n",
1293 "conv2d_7 (Conv2D) (None, 35, 35, 48) 9216 max_pooling2d_4[0][0] \n",
1294 "__________________________________________________________________________________________________\n",
1295 "conv2d_10 (Conv2D) (None, 35, 35, 96) 55296 activation_107[0][0] \n",
1296 "__________________________________________________________________________________________________\n",
1297 "batch_normalization_7 (BatchNor (None, 35, 35, 48) 144 conv2d_7[0][0] \n",
1298 "__________________________________________________________________________________________________\n",
1299 "batch_normalization_10 (BatchNo (None, 35, 35, 96) 288 conv2d_10[0][0] \n",
1300 "__________________________________________________________________________________________________\n",
1301 "activation_105 (Activation) (None, 35, 35, 48) 0 batch_normalization_7[0][0] \n",
1302 "__________________________________________________________________________________________________\n",
1303 "activation_108 (Activation) (None, 35, 35, 96) 0 batch_normalization_10[0][0] \n",
1304 "__________________________________________________________________________________________________\n",
1305 "average_pooling2d_1 (AveragePoo (None, 35, 35, 192) 0 max_pooling2d_4[0][0] \n",
1306 "__________________________________________________________________________________________________\n",
1307 "conv2d_6 (Conv2D) (None, 35, 35, 64) 12288 max_pooling2d_4[0][0] \n",
1308 "__________________________________________________________________________________________________\n",
1309 "conv2d_8 (Conv2D) (None, 35, 35, 64) 76800 activation_105[0][0] \n",
1310 "__________________________________________________________________________________________________\n",
1311 "conv2d_11 (Conv2D) (None, 35, 35, 96) 82944 activation_108[0][0] \n",
1312 "__________________________________________________________________________________________________\n",
1313 "conv2d_12 (Conv2D) (None, 35, 35, 32) 6144 average_pooling2d_1[0][0] \n",
1314 "__________________________________________________________________________________________________\n",
1315 "batch_normalization_6 (BatchNor (None, 35, 35, 64) 192 conv2d_6[0][0] \n",
1316 "__________________________________________________________________________________________________\n",
1317 "batch_normalization_8 (BatchNor (None, 35, 35, 64) 192 conv2d_8[0][0] \n",
1318 "__________________________________________________________________________________________________\n",
1319 "batch_normalization_11 (BatchNo (None, 35, 35, 96) 288 conv2d_11[0][0] \n",
1320 "__________________________________________________________________________________________________\n",
1321 "batch_normalization_12 (BatchNo (None, 35, 35, 32) 96 conv2d_12[0][0] \n",
1322 "__________________________________________________________________________________________________\n",
1323 "activation_104 (Activation) (None, 35, 35, 64) 0 batch_normalization_6[0][0] \n",
1324 "__________________________________________________________________________________________________\n",
1325 "activation_106 (Activation) (None, 35, 35, 64) 0 batch_normalization_8[0][0] \n",
1326 "__________________________________________________________________________________________________\n",
1327 "activation_109 (Activation) (None, 35, 35, 96) 0 batch_normalization_11[0][0] \n",
1328 "__________________________________________________________________________________________________\n",
1329 "activation_110 (Activation) (None, 35, 35, 32) 0 batch_normalization_12[0][0] \n",
1330 "__________________________________________________________________________________________________\n",
1331 "mixed0 (Concatenate) (None, 35, 35, 256) 0 activation_104[0][0] \n",
1332 " activation_106[0][0] \n",
1333 " activation_109[0][0] \n",
1334 " activation_110[0][0] \n",
1335 "__________________________________________________________________________________________________\n",
1336 "conv2d_16 (Conv2D) (None, 35, 35, 64) 16384 mixed0[0][0] \n",
1337 "__________________________________________________________________________________________________\n",
1338 "batch_normalization_16 (BatchNo (None, 35, 35, 64) 192 conv2d_16[0][0] \n",
1339 "__________________________________________________________________________________________________\n",
1340 "activation_114 (Activation) (None, 35, 35, 64) 0 batch_normalization_16[0][0] \n",
1341 "__________________________________________________________________________________________________\n",
1342 "conv2d_14 (Conv2D) (None, 35, 35, 48) 12288 mixed0[0][0] \n",
1343 "__________________________________________________________________________________________________\n",
1344 "conv2d_17 (Conv2D) (None, 35, 35, 96) 55296 activation_114[0][0] \n",
1345 "__________________________________________________________________________________________________\n",
1346 "batch_normalization_14 (BatchNo (None, 35, 35, 48) 144 conv2d_14[0][0] \n",
1347 "__________________________________________________________________________________________________\n",
1348 "batch_normalization_17 (BatchNo (None, 35, 35, 96) 288 conv2d_17[0][0] \n",
1349 "__________________________________________________________________________________________________\n",
1350 "activation_112 (Activation) (None, 35, 35, 48) 0 batch_normalization_14[0][0] \n",
1351 "__________________________________________________________________________________________________\n",
1352 "activation_115 (Activation) (None, 35, 35, 96) 0 batch_normalization_17[0][0] \n",
1353 "__________________________________________________________________________________________________\n",
1354 "average_pooling2d_2 (AveragePoo (None, 35, 35, 256) 0 mixed0[0][0] \n",
1355 "__________________________________________________________________________________________________\n",
1356 "conv2d_13 (Conv2D) (None, 35, 35, 64) 16384 mixed0[0][0] \n",
1357 "__________________________________________________________________________________________________\n",
1358 "conv2d_15 (Conv2D) (None, 35, 35, 64) 76800 activation_112[0][0] \n",
1359 "__________________________________________________________________________________________________\n",
1360 "conv2d_18 (Conv2D) (None, 35, 35, 96) 82944 activation_115[0][0] \n",
1361 "__________________________________________________________________________________________________\n",
1362 "conv2d_19 (Conv2D) (None, 35, 35, 64) 16384 average_pooling2d_2[0][0] \n",
1363 "__________________________________________________________________________________________________\n",
1364 "batch_normalization_13 (BatchNo (None, 35, 35, 64) 192 conv2d_13[0][0] \n",
1365 "__________________________________________________________________________________________________\n",
1366 "batch_normalization_15 (BatchNo (None, 35, 35, 64) 192 conv2d_15[0][0] \n",
1367 "__________________________________________________________________________________________________\n",
1368 "batch_normalization_18 (BatchNo (None, 35, 35, 96) 288 conv2d_18[0][0] \n",
1369 "__________________________________________________________________________________________________\n",
1370 "batch_normalization_19 (BatchNo (None, 35, 35, 64) 192 conv2d_19[0][0] \n",
1371 "__________________________________________________________________________________________________\n",
1372 "activation_111 (Activation) (None, 35, 35, 64) 0 batch_normalization_13[0][0] \n",
1373 "__________________________________________________________________________________________________\n",
1374 "activation_113 (Activation) (None, 35, 35, 64) 0 batch_normalization_15[0][0] \n",
1375 "__________________________________________________________________________________________________\n",
1376 "activation_116 (Activation) (None, 35, 35, 96) 0 batch_normalization_18[0][0] \n",
1377 "__________________________________________________________________________________________________\n",
1378 "activation_117 (Activation) (None, 35, 35, 64) 0 batch_normalization_19[0][0] \n",
1379 "__________________________________________________________________________________________________\n",
1380 "mixed1 (Concatenate) (None, 35, 35, 288) 0 activation_111[0][0] \n",
1381 " activation_113[0][0] \n",
1382 " activation_116[0][0] \n",
1383 " activation_117[0][0] \n",
1384 "__________________________________________________________________________________________________\n",
1385 "conv2d_23 (Conv2D) (None, 35, 35, 64) 18432 mixed1[0][0] \n",
1386 "__________________________________________________________________________________________________\n",
1387 "batch_normalization_23 (BatchNo (None, 35, 35, 64) 192 conv2d_23[0][0] \n",
1388 "__________________________________________________________________________________________________\n",
1389 "activation_121 (Activation) (None, 35, 35, 64) 0 batch_normalization_23[0][0] \n",
1390 "__________________________________________________________________________________________________\n",
1391 "conv2d_21 (Conv2D) (None, 35, 35, 48) 13824 mixed1[0][0] \n",
1392 "__________________________________________________________________________________________________\n",
1393 "conv2d_24 (Conv2D) (None, 35, 35, 96) 55296 activation_121[0][0] \n",
1394 "__________________________________________________________________________________________________\n",
1395 "batch_normalization_21 (BatchNo (None, 35, 35, 48) 144 conv2d_21[0][0] \n",
1396 "__________________________________________________________________________________________________\n",
1397 "batch_normalization_24 (BatchNo (None, 35, 35, 96) 288 conv2d_24[0][0] \n",
1398 "__________________________________________________________________________________________________\n",
1399 "activation_119 (Activation) (None, 35, 35, 48) 0 batch_normalization_21[0][0] \n",
1400 "__________________________________________________________________________________________________\n",
1401 "activation_122 (Activation) (None, 35, 35, 96) 0 batch_normalization_24[0][0] \n",
1402 "__________________________________________________________________________________________________\n",
1403 "average_pooling2d_3 (AveragePoo (None, 35, 35, 288) 0 mixed1[0][0] \n",
1404 "__________________________________________________________________________________________________\n",
1405 "conv2d_20 (Conv2D) (None, 35, 35, 64) 18432 mixed1[0][0] \n",
1406 "__________________________________________________________________________________________________\n",
1407 "conv2d_22 (Conv2D) (None, 35, 35, 64) 76800 activation_119[0][0] \n",
1408 "__________________________________________________________________________________________________\n",
1409 "conv2d_25 (Conv2D) (None, 35, 35, 96) 82944 activation_122[0][0] \n",
1410 "__________________________________________________________________________________________________\n",
1411 "conv2d_26 (Conv2D) (None, 35, 35, 64) 18432 average_pooling2d_3[0][0] \n",
1412 "__________________________________________________________________________________________________\n",
1413 "batch_normalization_20 (BatchNo (None, 35, 35, 64) 192 conv2d_20[0][0] \n",
1414 "__________________________________________________________________________________________________\n",
1415 "batch_normalization_22 (BatchNo (None, 35, 35, 64) 192 conv2d_22[0][0] \n",
1416 "__________________________________________________________________________________________________\n",
1417 "batch_normalization_25 (BatchNo (None, 35, 35, 96) 288 conv2d_25[0][0] \n",
1418 "__________________________________________________________________________________________________\n",
1419 "batch_normalization_26 (BatchNo (None, 35, 35, 64) 192 conv2d_26[0][0] \n",
1420 "__________________________________________________________________________________________________\n",
1421 "activation_118 (Activation) (None, 35, 35, 64) 0 batch_normalization_20[0][0] \n",
1422 "__________________________________________________________________________________________________\n",
1423 "activation_120 (Activation) (None, 35, 35, 64) 0 batch_normalization_22[0][0] \n",
1424 "__________________________________________________________________________________________________\n",
1425 "activation_123 (Activation) (None, 35, 35, 96) 0 batch_normalization_25[0][0] \n",
1426 "__________________________________________________________________________________________________\n",
1427 "activation_124 (Activation) (None, 35, 35, 64) 0 batch_normalization_26[0][0] \n",
1428 "__________________________________________________________________________________________________\n",
1429 "mixed2 (Concatenate) (None, 35, 35, 288) 0 activation_118[0][0] \n",
1430 " activation_120[0][0] \n",
1431 " activation_123[0][0] \n",
1432 " activation_124[0][0] \n",
1433 "__________________________________________________________________________________________________\n",
1434 "conv2d_28 (Conv2D) (None, 35, 35, 64) 18432 mixed2[0][0] \n",
1435 "__________________________________________________________________________________________________\n",
1436 "batch_normalization_28 (BatchNo (None, 35, 35, 64) 192 conv2d_28[0][0] \n",
1437 "__________________________________________________________________________________________________\n",
1438 "activation_126 (Activation) (None, 35, 35, 64) 0 batch_normalization_28[0][0] \n",
1439 "__________________________________________________________________________________________________\n",
1440 "conv2d_29 (Conv2D) (None, 35, 35, 96) 55296 activation_126[0][0] \n",
1441 "__________________________________________________________________________________________________\n",
1442 "batch_normalization_29 (BatchNo (None, 35, 35, 96) 288 conv2d_29[0][0] \n",
1443 "__________________________________________________________________________________________________\n",
1444 "activation_127 (Activation) (None, 35, 35, 96) 0 batch_normalization_29[0][0] \n",
1445 "__________________________________________________________________________________________________\n",
1446 "conv2d_27 (Conv2D) (None, 17, 17, 384) 995328 mixed2[0][0] \n",
1447 "__________________________________________________________________________________________________\n",
1448 "conv2d_30 (Conv2D) (None, 17, 17, 96) 82944 activation_127[0][0] \n",
1449 "__________________________________________________________________________________________________\n",
1450 "batch_normalization_27 (BatchNo (None, 17, 17, 384) 1152 conv2d_27[0][0] \n",
1451 "__________________________________________________________________________________________________\n",
1452 "batch_normalization_30 (BatchNo (None, 17, 17, 96) 288 conv2d_30[0][0] \n",
1453 "__________________________________________________________________________________________________\n",
1454 "activation_125 (Activation) (None, 17, 17, 384) 0 batch_normalization_27[0][0] \n",
1455 "__________________________________________________________________________________________________\n",
1456 "activation_128 (Activation) (None, 17, 17, 96) 0 batch_normalization_30[0][0] \n",
1457 "__________________________________________________________________________________________________\n",
1458 "max_pooling2d_5 (MaxPooling2D) (None, 17, 17, 288) 0 mixed2[0][0] \n",
1459 "__________________________________________________________________________________________________\n",
1460 "mixed3 (Concatenate) (None, 17, 17, 768) 0 activation_125[0][0] \n",
1461 " activation_128[0][0] \n",
1462 " max_pooling2d_5[0][0] \n",
1463 "__________________________________________________________________________________________________\n",
1464 "conv2d_35 (Conv2D) (None, 17, 17, 128) 98304 mixed3[0][0] \n",
1465 "__________________________________________________________________________________________________\n",
1466 "batch_normalization_35 (BatchNo (None, 17, 17, 128) 384 conv2d_35[0][0] \n",
1467 "__________________________________________________________________________________________________\n",
1468 "activation_133 (Activation) (None, 17, 17, 128) 0 batch_normalization_35[0][0] \n",
1469 "__________________________________________________________________________________________________\n",
1470 "conv2d_36 (Conv2D) (None, 17, 17, 128) 114688 activation_133[0][0] \n",
1471 "__________________________________________________________________________________________________\n",
1472 "batch_normalization_36 (BatchNo (None, 17, 17, 128) 384 conv2d_36[0][0] \n",
1473 "__________________________________________________________________________________________________\n",
1474 "activation_134 (Activation) (None, 17, 17, 128) 0 batch_normalization_36[0][0] \n",
1475 "__________________________________________________________________________________________________\n",
1476 "conv2d_32 (Conv2D) (None, 17, 17, 128) 98304 mixed3[0][0] \n",
1477 "__________________________________________________________________________________________________\n",
1478 "conv2d_37 (Conv2D) (None, 17, 17, 128) 114688 activation_134[0][0] \n",
1479 "__________________________________________________________________________________________________\n",
1480 "batch_normalization_32 (BatchNo (None, 17, 17, 128) 384 conv2d_32[0][0] \n",
1481 "__________________________________________________________________________________________________\n",
1482 "batch_normalization_37 (BatchNo (None, 17, 17, 128) 384 conv2d_37[0][0] \n",
1483 "__________________________________________________________________________________________________\n",
1484 "activation_130 (Activation) (None, 17, 17, 128) 0 batch_normalization_32[0][0] \n",
1485 "__________________________________________________________________________________________________\n",
1486 "activation_135 (Activation) (None, 17, 17, 128) 0 batch_normalization_37[0][0] \n",
1487 "__________________________________________________________________________________________________\n",
1488 "conv2d_33 (Conv2D) (None, 17, 17, 128) 114688 activation_130[0][0] \n",
1489 "__________________________________________________________________________________________________\n",
1490 "conv2d_38 (Conv2D) (None, 17, 17, 128) 114688 activation_135[0][0] \n",
1491 "__________________________________________________________________________________________________\n",
1492 "batch_normalization_33 (BatchNo (None, 17, 17, 128) 384 conv2d_33[0][0] \n",
1493 "__________________________________________________________________________________________________\n",
1494 "batch_normalization_38 (BatchNo (None, 17, 17, 128) 384 conv2d_38[0][0] \n",
1495 "__________________________________________________________________________________________________\n",
1496 "activation_131 (Activation) (None, 17, 17, 128) 0 batch_normalization_33[0][0] \n",
1497 "__________________________________________________________________________________________________\n",
1498 "activation_136 (Activation) (None, 17, 17, 128) 0 batch_normalization_38[0][0] \n",
1499 "__________________________________________________________________________________________________\n",
1500 "average_pooling2d_4 (AveragePoo (None, 17, 17, 768) 0 mixed3[0][0] \n",
1501 "__________________________________________________________________________________________________\n",
1502 "conv2d_31 (Conv2D) (None, 17, 17, 192) 147456 mixed3[0][0] \n",
1503 "__________________________________________________________________________________________________\n",
1504 "conv2d_34 (Conv2D) (None, 17, 17, 192) 172032 activation_131[0][0] \n",
1505 "__________________________________________________________________________________________________\n",
1506 "conv2d_39 (Conv2D) (None, 17, 17, 192) 172032 activation_136[0][0] \n",
1507 "__________________________________________________________________________________________________\n",
1508 "conv2d_40 (Conv2D) (None, 17, 17, 192) 147456 average_pooling2d_4[0][0] \n",
1509 "__________________________________________________________________________________________________\n",
1510 "batch_normalization_31 (BatchNo (None, 17, 17, 192) 576 conv2d_31[0][0] \n",
1511 "__________________________________________________________________________________________________\n",
1512 "batch_normalization_34 (BatchNo (None, 17, 17, 192) 576 conv2d_34[0][0] \n",
1513 "__________________________________________________________________________________________________\n",
1514 "batch_normalization_39 (BatchNo (None, 17, 17, 192) 576 conv2d_39[0][0] \n",
1515 "__________________________________________________________________________________________________\n",
1516 "batch_normalization_40 (BatchNo (None, 17, 17, 192) 576 conv2d_40[0][0] \n",
1517 "__________________________________________________________________________________________________\n",
1518 "activation_129 (Activation) (None, 17, 17, 192) 0 batch_normalization_31[0][0] \n",
1519 "__________________________________________________________________________________________________\n",
1520 "activation_132 (Activation) (None, 17, 17, 192) 0 batch_normalization_34[0][0] \n",
1521 "__________________________________________________________________________________________________\n",
1522 "activation_137 (Activation) (None, 17, 17, 192) 0 batch_normalization_39[0][0] \n",
1523 "__________________________________________________________________________________________________\n",
1524 "activation_138 (Activation) (None, 17, 17, 192) 0 batch_normalization_40[0][0] \n",
1525 "__________________________________________________________________________________________________\n",
1526 "mixed4 (Concatenate) (None, 17, 17, 768) 0 activation_129[0][0] \n",
1527 " activation_132[0][0] \n",
1528 " activation_137[0][0] \n",
1529 " activation_138[0][0] \n",
1530 "__________________________________________________________________________________________________\n",
1531 "conv2d_45 (Conv2D) (None, 17, 17, 160) 122880 mixed4[0][0] \n",
1532 "__________________________________________________________________________________________________\n",
1533 "batch_normalization_45 (BatchNo (None, 17, 17, 160) 480 conv2d_45[0][0] \n",
1534 "__________________________________________________________________________________________________\n",
1535 "activation_143 (Activation) (None, 17, 17, 160) 0 batch_normalization_45[0][0] \n",
1536 "__________________________________________________________________________________________________\n",
1537 "conv2d_46 (Conv2D) (None, 17, 17, 160) 179200 activation_143[0][0] \n",
1538 "__________________________________________________________________________________________________\n",
1539 "batch_normalization_46 (BatchNo (None, 17, 17, 160) 480 conv2d_46[0][0] \n",
1540 "__________________________________________________________________________________________________\n",
1541 "activation_144 (Activation) (None, 17, 17, 160) 0 batch_normalization_46[0][0] \n",
1542 "__________________________________________________________________________________________________\n",
1543 "conv2d_42 (Conv2D) (None, 17, 17, 160) 122880 mixed4[0][0] \n",
1544 "__________________________________________________________________________________________________\n",
1545 "conv2d_47 (Conv2D) (None, 17, 17, 160) 179200 activation_144[0][0] \n",
1546 "__________________________________________________________________________________________________\n",
1547 "batch_normalization_42 (BatchNo (None, 17, 17, 160) 480 conv2d_42[0][0] \n",
1548 "__________________________________________________________________________________________________\n",
1549 "batch_normalization_47 (BatchNo (None, 17, 17, 160) 480 conv2d_47[0][0] \n",
1550 "__________________________________________________________________________________________________\n",
1551 "activation_140 (Activation) (None, 17, 17, 160) 0 batch_normalization_42[0][0] \n",
1552 "__________________________________________________________________________________________________\n",
1553 "activation_145 (Activation) (None, 17, 17, 160) 0 batch_normalization_47[0][0] \n",
1554 "__________________________________________________________________________________________________\n",
1555 "conv2d_43 (Conv2D) (None, 17, 17, 160) 179200 activation_140[0][0] \n",
1556 "__________________________________________________________________________________________________\n",
1557 "conv2d_48 (Conv2D) (None, 17, 17, 160) 179200 activation_145[0][0] \n",
1558 "__________________________________________________________________________________________________\n",
1559 "batch_normalization_43 (BatchNo (None, 17, 17, 160) 480 conv2d_43[0][0] \n",
1560 "__________________________________________________________________________________________________\n",
1561 "batch_normalization_48 (BatchNo (None, 17, 17, 160) 480 conv2d_48[0][0] \n",
1562 "__________________________________________________________________________________________________\n",
1563 "activation_141 (Activation) (None, 17, 17, 160) 0 batch_normalization_43[0][0] \n",
1564 "__________________________________________________________________________________________________\n",
1565 "activation_146 (Activation) (None, 17, 17, 160) 0 batch_normalization_48[0][0] \n",
1566 "__________________________________________________________________________________________________\n",
1567 "average_pooling2d_5 (AveragePoo (None, 17, 17, 768) 0 mixed4[0][0] \n",
1568 "__________________________________________________________________________________________________\n",
1569 "conv2d_41 (Conv2D) (None, 17, 17, 192) 147456 mixed4[0][0] \n",
1570 "__________________________________________________________________________________________________\n",
1571 "conv2d_44 (Conv2D) (None, 17, 17, 192) 215040 activation_141[0][0] \n",
1572 "__________________________________________________________________________________________________\n",
1573 "conv2d_49 (Conv2D) (None, 17, 17, 192) 215040 activation_146[0][0] \n",
1574 "__________________________________________________________________________________________________\n",
1575 "conv2d_50 (Conv2D) (None, 17, 17, 192) 147456 average_pooling2d_5[0][0] \n",
1576 "__________________________________________________________________________________________________\n",
1577 "batch_normalization_41 (BatchNo (None, 17, 17, 192) 576 conv2d_41[0][0] \n",
1578 "__________________________________________________________________________________________________\n",
1579 "batch_normalization_44 (BatchNo (None, 17, 17, 192) 576 conv2d_44[0][0] \n",
1580 "__________________________________________________________________________________________________\n",
1581 "batch_normalization_49 (BatchNo (None, 17, 17, 192) 576 conv2d_49[0][0] \n",
1582 "__________________________________________________________________________________________________\n",
1583 "batch_normalization_50 (BatchNo (None, 17, 17, 192) 576 conv2d_50[0][0] \n",
1584 "__________________________________________________________________________________________________\n",
1585 "activation_139 (Activation) (None, 17, 17, 192) 0 batch_normalization_41[0][0] \n",
1586 "__________________________________________________________________________________________________\n",
1587 "activation_142 (Activation) (None, 17, 17, 192) 0 batch_normalization_44[0][0] \n",
1588 "__________________________________________________________________________________________________\n",
1589 "activation_147 (Activation) (None, 17, 17, 192) 0 batch_normalization_49[0][0] \n",
1590 "__________________________________________________________________________________________________\n",
1591 "activation_148 (Activation) (None, 17, 17, 192) 0 batch_normalization_50[0][0] \n",
1592 "__________________________________________________________________________________________________\n",
1593 "mixed5 (Concatenate) (None, 17, 17, 768) 0 activation_139[0][0] \n",
1594 " activation_142[0][0] \n",
1595 " activation_147[0][0] \n",
1596 " activation_148[0][0] \n",
1597 "__________________________________________________________________________________________________\n",
1598 "conv2d_55 (Conv2D) (None, 17, 17, 160) 122880 mixed5[0][0] \n",
1599 "__________________________________________________________________________________________________\n",
1600 "batch_normalization_55 (BatchNo (None, 17, 17, 160) 480 conv2d_55[0][0] \n",
1601 "__________________________________________________________________________________________________\n",
1602 "activation_153 (Activation) (None, 17, 17, 160) 0 batch_normalization_55[0][0] \n",
1603 "__________________________________________________________________________________________________\n",
1604 "conv2d_56 (Conv2D) (None, 17, 17, 160) 179200 activation_153[0][0] \n",
1605 "__________________________________________________________________________________________________\n",
1606 "batch_normalization_56 (BatchNo (None, 17, 17, 160) 480 conv2d_56[0][0] \n",
1607 "__________________________________________________________________________________________________\n",
1608 "activation_154 (Activation) (None, 17, 17, 160) 0 batch_normalization_56[0][0] \n",
1609 "__________________________________________________________________________________________________\n",
1610 "conv2d_52 (Conv2D) (None, 17, 17, 160) 122880 mixed5[0][0] \n",
1611 "__________________________________________________________________________________________________\n",
1612 "conv2d_57 (Conv2D) (None, 17, 17, 160) 179200 activation_154[0][0] \n",
1613 "__________________________________________________________________________________________________\n",
1614 "batch_normalization_52 (BatchNo (None, 17, 17, 160) 480 conv2d_52[0][0] \n",
1615 "__________________________________________________________________________________________________\n",
1616 "batch_normalization_57 (BatchNo (None, 17, 17, 160) 480 conv2d_57[0][0] \n",
1617 "__________________________________________________________________________________________________\n",
1618 "activation_150 (Activation) (None, 17, 17, 160) 0 batch_normalization_52[0][0] \n",
1619 "__________________________________________________________________________________________________\n",
1620 "activation_155 (Activation) (None, 17, 17, 160) 0 batch_normalization_57[0][0] \n",
1621 "__________________________________________________________________________________________________\n",
1622 "conv2d_53 (Conv2D) (None, 17, 17, 160) 179200 activation_150[0][0] \n",
1623 "__________________________________________________________________________________________________\n",
1624 "conv2d_58 (Conv2D) (None, 17, 17, 160) 179200 activation_155[0][0] \n",
1625 "__________________________________________________________________________________________________\n",
1626 "batch_normalization_53 (BatchNo (None, 17, 17, 160) 480 conv2d_53[0][0] \n",
1627 "__________________________________________________________________________________________________\n",
1628 "batch_normalization_58 (BatchNo (None, 17, 17, 160) 480 conv2d_58[0][0] \n",
1629 "__________________________________________________________________________________________________\n",
1630 "activation_151 (Activation) (None, 17, 17, 160) 0 batch_normalization_53[0][0] \n",
1631 "__________________________________________________________________________________________________\n",
1632 "activation_156 (Activation) (None, 17, 17, 160) 0 batch_normalization_58[0][0] \n",
1633 "__________________________________________________________________________________________________\n",
1634 "average_pooling2d_6 (AveragePoo (None, 17, 17, 768) 0 mixed5[0][0] \n",
1635 "__________________________________________________________________________________________________\n",
1636 "conv2d_51 (Conv2D) (None, 17, 17, 192) 147456 mixed5[0][0] \n",
1637 "__________________________________________________________________________________________________\n",
1638 "conv2d_54 (Conv2D) (None, 17, 17, 192) 215040 activation_151[0][0] \n",
1639 "__________________________________________________________________________________________________\n",
1640 "conv2d_59 (Conv2D) (None, 17, 17, 192) 215040 activation_156[0][0] \n",
1641 "__________________________________________________________________________________________________\n",
1642 "conv2d_60 (Conv2D) (None, 17, 17, 192) 147456 average_pooling2d_6[0][0] \n",
1643 "__________________________________________________________________________________________________\n",
1644 "batch_normalization_51 (BatchNo (None, 17, 17, 192) 576 conv2d_51[0][0] \n",
1645 "__________________________________________________________________________________________________\n",
1646 "batch_normalization_54 (BatchNo (None, 17, 17, 192) 576 conv2d_54[0][0] \n",
1647 "__________________________________________________________________________________________________\n",
1648 "batch_normalization_59 (BatchNo (None, 17, 17, 192) 576 conv2d_59[0][0] \n",
1649 "__________________________________________________________________________________________________\n",
1650 "batch_normalization_60 (BatchNo (None, 17, 17, 192) 576 conv2d_60[0][0] \n",
1651 "__________________________________________________________________________________________________\n",
1652 "activation_149 (Activation) (None, 17, 17, 192) 0 batch_normalization_51[0][0] \n",
1653 "__________________________________________________________________________________________________\n",
1654 "activation_152 (Activation) (None, 17, 17, 192) 0 batch_normalization_54[0][0] \n",
1655 "__________________________________________________________________________________________________\n",
1656 "activation_157 (Activation) (None, 17, 17, 192) 0 batch_normalization_59[0][0] \n",
1657 "__________________________________________________________________________________________________\n",
1658 "activation_158 (Activation) (None, 17, 17, 192) 0 batch_normalization_60[0][0] \n",
1659 "__________________________________________________________________________________________________\n",
1660 "mixed6 (Concatenate) (None, 17, 17, 768) 0 activation_149[0][0] \n",
1661 " activation_152[0][0] \n",
1662 " activation_157[0][0] \n",
1663 " activation_158[0][0] \n",
1664 "__________________________________________________________________________________________________\n",
1665 "conv2d_65 (Conv2D) (None, 17, 17, 192) 147456 mixed6[0][0] \n",
1666 "__________________________________________________________________________________________________\n",
1667 "batch_normalization_65 (BatchNo (None, 17, 17, 192) 576 conv2d_65[0][0] \n",
1668 "__________________________________________________________________________________________________\n",
1669 "activation_163 (Activation) (None, 17, 17, 192) 0 batch_normalization_65[0][0] \n",
1670 "__________________________________________________________________________________________________\n",
1671 "conv2d_66 (Conv2D) (None, 17, 17, 192) 258048 activation_163[0][0] \n",
1672 "__________________________________________________________________________________________________\n",
1673 "batch_normalization_66 (BatchNo (None, 17, 17, 192) 576 conv2d_66[0][0] \n",
1674 "__________________________________________________________________________________________________\n",
1675 "activation_164 (Activation) (None, 17, 17, 192) 0 batch_normalization_66[0][0] \n",
1676 "__________________________________________________________________________________________________\n",
1677 "conv2d_62 (Conv2D) (None, 17, 17, 192) 147456 mixed6[0][0] \n",
1678 "__________________________________________________________________________________________________\n",
1679 "conv2d_67 (Conv2D) (None, 17, 17, 192) 258048 activation_164[0][0] \n",
1680 "__________________________________________________________________________________________________\n",
1681 "batch_normalization_62 (BatchNo (None, 17, 17, 192) 576 conv2d_62[0][0] \n",
1682 "__________________________________________________________________________________________________\n",
1683 "batch_normalization_67 (BatchNo (None, 17, 17, 192) 576 conv2d_67[0][0] \n",
1684 "__________________________________________________________________________________________________\n",
1685 "activation_160 (Activation) (None, 17, 17, 192) 0 batch_normalization_62[0][0] \n",
1686 "__________________________________________________________________________________________________\n",
1687 "activation_165 (Activation) (None, 17, 17, 192) 0 batch_normalization_67[0][0] \n",
1688 "__________________________________________________________________________________________________\n",
1689 "conv2d_63 (Conv2D) (None, 17, 17, 192) 258048 activation_160[0][0] \n",
1690 "__________________________________________________________________________________________________\n",
1691 "conv2d_68 (Conv2D) (None, 17, 17, 192) 258048 activation_165[0][0] \n",
1692 "__________________________________________________________________________________________________\n",
1693 "batch_normalization_63 (BatchNo (None, 17, 17, 192) 576 conv2d_63[0][0] \n",
1694 "__________________________________________________________________________________________________\n",
1695 "batch_normalization_68 (BatchNo (None, 17, 17, 192) 576 conv2d_68[0][0] \n",
1696 "__________________________________________________________________________________________________\n",
1697 "activation_161 (Activation) (None, 17, 17, 192) 0 batch_normalization_63[0][0] \n",
1698 "__________________________________________________________________________________________________\n",
1699 "activation_166 (Activation) (None, 17, 17, 192) 0 batch_normalization_68[0][0] \n",
1700 "__________________________________________________________________________________________________\n",
1701 "average_pooling2d_7 (AveragePoo (None, 17, 17, 768) 0 mixed6[0][0] \n",
1702 "__________________________________________________________________________________________________\n",
1703 "conv2d_61 (Conv2D) (None, 17, 17, 192) 147456 mixed6[0][0] \n",
1704 "__________________________________________________________________________________________________\n",
1705 "conv2d_64 (Conv2D) (None, 17, 17, 192) 258048 activation_161[0][0] \n",
1706 "__________________________________________________________________________________________________\n",
1707 "conv2d_69 (Conv2D) (None, 17, 17, 192) 258048 activation_166[0][0] \n",
1708 "__________________________________________________________________________________________________\n",
1709 "conv2d_70 (Conv2D) (None, 17, 17, 192) 147456 average_pooling2d_7[0][0] \n",
1710 "__________________________________________________________________________________________________\n",
1711 "batch_normalization_61 (BatchNo (None, 17, 17, 192) 576 conv2d_61[0][0] \n",
1712 "__________________________________________________________________________________________________\n",
1713 "batch_normalization_64 (BatchNo (None, 17, 17, 192) 576 conv2d_64[0][0] \n",
1714 "__________________________________________________________________________________________________\n",
1715 "batch_normalization_69 (BatchNo (None, 17, 17, 192) 576 conv2d_69[0][0] \n",
1716 "__________________________________________________________________________________________________\n",
1717 "batch_normalization_70 (BatchNo (None, 17, 17, 192) 576 conv2d_70[0][0] \n",
1718 "__________________________________________________________________________________________________\n",
1719 "activation_159 (Activation) (None, 17, 17, 192) 0 batch_normalization_61[0][0] \n",
1720 "__________________________________________________________________________________________________\n",
1721 "activation_162 (Activation) (None, 17, 17, 192) 0 batch_normalization_64[0][0] \n",
1722 "__________________________________________________________________________________________________\n",
1723 "activation_167 (Activation) (None, 17, 17, 192) 0 batch_normalization_69[0][0] \n",
1724 "__________________________________________________________________________________________________\n",
1725 "activation_168 (Activation) (None, 17, 17, 192) 0 batch_normalization_70[0][0] \n",
1726 "__________________________________________________________________________________________________\n",
1727 "mixed7 (Concatenate) (None, 17, 17, 768) 0 activation_159[0][0] \n",
1728 " activation_162[0][0] \n",
1729 " activation_167[0][0] \n",
1730 " activation_168[0][0] \n",
1731 "__________________________________________________________________________________________________\n",
1732 "conv2d_73 (Conv2D) (None, 17, 17, 192) 147456 mixed7[0][0] \n",
1733 "__________________________________________________________________________________________________\n",
1734 "batch_normalization_73 (BatchNo (None, 17, 17, 192) 576 conv2d_73[0][0] \n",
1735 "__________________________________________________________________________________________________\n",
1736 "activation_171 (Activation) (None, 17, 17, 192) 0 batch_normalization_73[0][0] \n",
1737 "__________________________________________________________________________________________________\n",
1738 "conv2d_74 (Conv2D) (None, 17, 17, 192) 258048 activation_171[0][0] \n",
1739 "__________________________________________________________________________________________________\n",
1740 "batch_normalization_74 (BatchNo (None, 17, 17, 192) 576 conv2d_74[0][0] \n",
1741 "__________________________________________________________________________________________________\n",
1742 "activation_172 (Activation) (None, 17, 17, 192) 0 batch_normalization_74[0][0] \n",
1743 "__________________________________________________________________________________________________\n",
1744 "conv2d_71 (Conv2D) (None, 17, 17, 192) 147456 mixed7[0][0] \n",
1745 "__________________________________________________________________________________________________\n",
1746 "conv2d_75 (Conv2D) (None, 17, 17, 192) 258048 activation_172[0][0] \n",
1747 "__________________________________________________________________________________________________\n",
1748 "batch_normalization_71 (BatchNo (None, 17, 17, 192) 576 conv2d_71[0][0] \n",
1749 "__________________________________________________________________________________________________\n",
1750 "batch_normalization_75 (BatchNo (None, 17, 17, 192) 576 conv2d_75[0][0] \n",
1751 "__________________________________________________________________________________________________\n",
1752 "activation_169 (Activation) (None, 17, 17, 192) 0 batch_normalization_71[0][0] \n",
1753 "__________________________________________________________________________________________________\n",
1754 "activation_173 (Activation) (None, 17, 17, 192) 0 batch_normalization_75[0][0] \n",
1755 "__________________________________________________________________________________________________\n",
1756 "conv2d_72 (Conv2D) (None, 8, 8, 320) 552960 activation_169[0][0] \n",
1757 "__________________________________________________________________________________________________\n",
1758 "conv2d_76 (Conv2D) (None, 8, 8, 192) 331776 activation_173[0][0] \n",
1759 "__________________________________________________________________________________________________\n",
1760 "batch_normalization_72 (BatchNo (None, 8, 8, 320) 960 conv2d_72[0][0] \n",
1761 "__________________________________________________________________________________________________\n",
1762 "batch_normalization_76 (BatchNo (None, 8, 8, 192) 576 conv2d_76[0][0] \n",
1763 "__________________________________________________________________________________________________\n",
1764 "activation_170 (Activation) (None, 8, 8, 320) 0 batch_normalization_72[0][0] \n",
1765 "__________________________________________________________________________________________________\n",
1766 "activation_174 (Activation) (None, 8, 8, 192) 0 batch_normalization_76[0][0] \n",
1767 "__________________________________________________________________________________________________\n",
1768 "max_pooling2d_6 (MaxPooling2D) (None, 8, 8, 768) 0 mixed7[0][0] \n",
1769 "__________________________________________________________________________________________________\n",
1770 "mixed8 (Concatenate) (None, 8, 8, 1280) 0 activation_170[0][0] \n",
1771 " activation_174[0][0] \n",
1772 " max_pooling2d_6[0][0] \n",
1773 "__________________________________________________________________________________________________\n",
1774 "conv2d_81 (Conv2D) (None, 8, 8, 448) 573440 mixed8[0][0] \n",
1775 "__________________________________________________________________________________________________\n",
1776 "batch_normalization_81 (BatchNo (None, 8, 8, 448) 1344 conv2d_81[0][0] \n",
1777 "__________________________________________________________________________________________________\n",
1778 "activation_179 (Activation) (None, 8, 8, 448) 0 batch_normalization_81[0][0] \n",
1779 "__________________________________________________________________________________________________\n",
1780 "conv2d_78 (Conv2D) (None, 8, 8, 384) 491520 mixed8[0][0] \n",
1781 "__________________________________________________________________________________________________\n",
1782 "conv2d_82 (Conv2D) (None, 8, 8, 384) 1548288 activation_179[0][0] \n",
1783 "__________________________________________________________________________________________________\n",
1784 "batch_normalization_78 (BatchNo (None, 8, 8, 384) 1152 conv2d_78[0][0] \n",
1785 "__________________________________________________________________________________________________\n",
1786 "batch_normalization_82 (BatchNo (None, 8, 8, 384) 1152 conv2d_82[0][0] \n",
1787 "__________________________________________________________________________________________________\n",
1788 "activation_176 (Activation) (None, 8, 8, 384) 0 batch_normalization_78[0][0] \n",
1789 "__________________________________________________________________________________________________\n",
1790 "activation_180 (Activation) (None, 8, 8, 384) 0 batch_normalization_82[0][0] \n",
1791 "__________________________________________________________________________________________________\n",
1792 "conv2d_79 (Conv2D) (None, 8, 8, 384) 442368 activation_176[0][0] \n",
1793 "__________________________________________________________________________________________________\n",
1794 "conv2d_80 (Conv2D) (None, 8, 8, 384) 442368 activation_176[0][0] \n",
1795 "__________________________________________________________________________________________________\n",
1796 "conv2d_83 (Conv2D) (None, 8, 8, 384) 442368 activation_180[0][0] \n",
1797 "__________________________________________________________________________________________________\n",
1798 "conv2d_84 (Conv2D) (None, 8, 8, 384) 442368 activation_180[0][0] \n",
1799 "__________________________________________________________________________________________________\n",
1800 "average_pooling2d_8 (AveragePoo (None, 8, 8, 1280) 0 mixed8[0][0] \n",
1801 "__________________________________________________________________________________________________\n",
1802 "conv2d_77 (Conv2D) (None, 8, 8, 320) 409600 mixed8[0][0] \n",
1803 "__________________________________________________________________________________________________\n",
1804 "batch_normalization_79 (BatchNo (None, 8, 8, 384) 1152 conv2d_79[0][0] \n",
1805 "__________________________________________________________________________________________________\n",
1806 "batch_normalization_80 (BatchNo (None, 8, 8, 384) 1152 conv2d_80[0][0] \n",
1807 "__________________________________________________________________________________________________\n",
1808 "batch_normalization_83 (BatchNo (None, 8, 8, 384) 1152 conv2d_83[0][0] \n",
1809 "__________________________________________________________________________________________________\n",
1810 "batch_normalization_84 (BatchNo (None, 8, 8, 384) 1152 conv2d_84[0][0] \n",
1811 "__________________________________________________________________________________________________\n",
1812 "conv2d_85 (Conv2D) (None, 8, 8, 192) 245760 average_pooling2d_8[0][0] \n",
1813 "__________________________________________________________________________________________________\n",
1814 "batch_normalization_77 (BatchNo (None, 8, 8, 320) 960 conv2d_77[0][0] \n",
1815 "__________________________________________________________________________________________________\n",
1816 "activation_177 (Activation) (None, 8, 8, 384) 0 batch_normalization_79[0][0] \n",
1817 "__________________________________________________________________________________________________\n",
1818 "activation_178 (Activation) (None, 8, 8, 384) 0 batch_normalization_80[0][0] \n",
1819 "__________________________________________________________________________________________________\n",
1820 "activation_181 (Activation) (None, 8, 8, 384) 0 batch_normalization_83[0][0] \n",
1821 "__________________________________________________________________________________________________\n",
1822 "activation_182 (Activation) (None, 8, 8, 384) 0 batch_normalization_84[0][0] \n",
1823 "__________________________________________________________________________________________________\n",
1824 "batch_normalization_85 (BatchNo (None, 8, 8, 192) 576 conv2d_85[0][0] \n",
1825 "__________________________________________________________________________________________________\n",
1826 "activation_175 (Activation) (None, 8, 8, 320) 0 batch_normalization_77[0][0] \n",
1827 "__________________________________________________________________________________________________\n",
1828 "mixed9_0 (Concatenate) (None, 8, 8, 768) 0 activation_177[0][0] \n",
1829 " activation_178[0][0] \n",
1830 "__________________________________________________________________________________________________\n",
1831 "concatenate_1 (Concatenate) (None, 8, 8, 768) 0 activation_181[0][0] \n",
1832 " activation_182[0][0] \n",
1833 "__________________________________________________________________________________________________\n",
1834 "activation_183 (Activation) (None, 8, 8, 192) 0 batch_normalization_85[0][0] \n",
1835 "__________________________________________________________________________________________________\n",
1836 "mixed9 (Concatenate) (None, 8, 8, 2048) 0 activation_175[0][0] \n",
1837 " mixed9_0[0][0] \n",
1838 " concatenate_1[0][0] \n",
1839 " activation_183[0][0] \n",
1840 "__________________________________________________________________________________________________\n",
1841 "conv2d_90 (Conv2D) (None, 8, 8, 448) 917504 mixed9[0][0] \n",
1842 "__________________________________________________________________________________________________\n",
1843 "batch_normalization_90 (BatchNo (None, 8, 8, 448) 1344 conv2d_90[0][0] \n",
1844 "__________________________________________________________________________________________________\n",
1845 "activation_188 (Activation) (None, 8, 8, 448) 0 batch_normalization_90[0][0] \n",
1846 "__________________________________________________________________________________________________\n",
1847 "conv2d_87 (Conv2D) (None, 8, 8, 384) 786432 mixed9[0][0] \n",
1848 "__________________________________________________________________________________________________\n",
1849 "conv2d_91 (Conv2D) (None, 8, 8, 384) 1548288 activation_188[0][0] \n",
1850 "__________________________________________________________________________________________________\n",
1851 "batch_normalization_87 (BatchNo (None, 8, 8, 384) 1152 conv2d_87[0][0] \n",
1852 "__________________________________________________________________________________________________\n",
1853 "batch_normalization_91 (BatchNo (None, 8, 8, 384) 1152 conv2d_91[0][0] \n",
1854 "__________________________________________________________________________________________________\n",
1855 "activation_185 (Activation) (None, 8, 8, 384) 0 batch_normalization_87[0][0] \n",
1856 "__________________________________________________________________________________________________\n",
1857 "activation_189 (Activation) (None, 8, 8, 384) 0 batch_normalization_91[0][0] \n",
1858 "__________________________________________________________________________________________________\n",
1859 "conv2d_88 (Conv2D) (None, 8, 8, 384) 442368 activation_185[0][0] \n",
1860 "__________________________________________________________________________________________________\n",
1861 "conv2d_89 (Conv2D) (None, 8, 8, 384) 442368 activation_185[0][0] \n",
1862 "__________________________________________________________________________________________________\n",
1863 "conv2d_92 (Conv2D) (None, 8, 8, 384) 442368 activation_189[0][0] \n",
1864 "__________________________________________________________________________________________________\n",
1865 "conv2d_93 (Conv2D) (None, 8, 8, 384) 442368 activation_189[0][0] \n",
1866 "__________________________________________________________________________________________________\n",
1867 "average_pooling2d_9 (AveragePoo (None, 8, 8, 2048) 0 mixed9[0][0] \n",
1868 "__________________________________________________________________________________________________\n",
1869 "conv2d_86 (Conv2D) (None, 8, 8, 320) 655360 mixed9[0][0] \n",
1870 "__________________________________________________________________________________________________\n",
1871 "batch_normalization_88 (BatchNo (None, 8, 8, 384) 1152 conv2d_88[0][0] \n",
1872 "__________________________________________________________________________________________________\n",
1873 "batch_normalization_89 (BatchNo (None, 8, 8, 384) 1152 conv2d_89[0][0] \n",
1874 "__________________________________________________________________________________________________\n",
1875 "batch_normalization_92 (BatchNo (None, 8, 8, 384) 1152 conv2d_92[0][0] \n",
1876 "__________________________________________________________________________________________________\n",
1877 "batch_normalization_93 (BatchNo (None, 8, 8, 384) 1152 conv2d_93[0][0] \n",
1878 "__________________________________________________________________________________________________\n",
1879 "conv2d_94 (Conv2D) (None, 8, 8, 192) 393216 average_pooling2d_9[0][0] \n",
1880 "__________________________________________________________________________________________________\n",
1881 "batch_normalization_86 (BatchNo (None, 8, 8, 320) 960 conv2d_86[0][0] \n",
1882 "__________________________________________________________________________________________________\n",
1883 "activation_186 (Activation) (None, 8, 8, 384) 0 batch_normalization_88[0][0] \n",
1884 "__________________________________________________________________________________________________\n",
1885 "activation_187 (Activation) (None, 8, 8, 384) 0 batch_normalization_89[0][0] \n",
1886 "__________________________________________________________________________________________________\n",
1887 "activation_190 (Activation) (None, 8, 8, 384) 0 batch_normalization_92[0][0] \n",
1888 "__________________________________________________________________________________________________\n",
1889 "activation_191 (Activation) (None, 8, 8, 384) 0 batch_normalization_93[0][0] \n",
1890 "__________________________________________________________________________________________________\n",
1891 "batch_normalization_94 (BatchNo (None, 8, 8, 192) 576 conv2d_94[0][0] \n",
1892 "__________________________________________________________________________________________________\n",
1893 "activation_184 (Activation) (None, 8, 8, 320) 0 batch_normalization_86[0][0] \n",
1894 "__________________________________________________________________________________________________\n",
1895 "mixed9_1 (Concatenate) (None, 8, 8, 768) 0 activation_186[0][0] \n",
1896 " activation_187[0][0] \n",
1897 "__________________________________________________________________________________________________\n",
1898 "concatenate_2 (Concatenate) (None, 8, 8, 768) 0 activation_190[0][0] \n",
1899 " activation_191[0][0] \n",
1900 "__________________________________________________________________________________________________\n",
1901 "activation_192 (Activation) (None, 8, 8, 192) 0 batch_normalization_94[0][0] \n",
1902 "__________________________________________________________________________________________________\n",
1903 "mixed10 (Concatenate) (None, 8, 8, 2048) 0 activation_184[0][0] \n",
1904 " mixed9_1[0][0] \n",
1905 " concatenate_2[0][0] \n",
1906 " activation_192[0][0] \n",
1907 "__________________________________________________________________________________________________\n",
1908 "avg_pool (GlobalAveragePooling2 (None, 2048) 0 mixed10[0][0] \n",
1909 "__________________________________________________________________________________________________\n",
1910 "predictions (Dense) (None, 1000) 2049000 avg_pool[0][0] \n",
1911 "==================================================================================================\n",
1912 "Total params: 23,851,784\n",
1913 "Trainable params: 23,817,352\n",
1914 "Non-trainable params: 34,432\n",
1915 "__________________________________________________________________________________________________\n"
1916 ]
1917 }
1918 ],
1919 "source": [
1920 "inception = InceptionV3()\n",
1921 "inception.summary()"
1922 ]
1923 },
1924 {
1925 "cell_type": "markdown",
1926 "metadata": {},
1927 "source": [
1928 "### Without final layer"
1929 ]
1930 },
1931 {
1932 "cell_type": "code",
1933 "execution_count": 24,
1934 "metadata": {
1935 "ExecuteTime": {
1936 "end_time": "2017-06-06T01:58:01.220832Z",
1937 "start_time": "2017-06-06T01:57:37.388982Z"
1938 }
1939 },
1940 "outputs": [
1941 {
1942 "name": "stdout",
1943 "output_type": "stream",
1944 "text": [
1945 "Downloading data from https://github.com/fchollet/deep-learning-models/releases/download/v0.5/inception_v3_weights_tf_dim_ordering_tf_kernels_notop.h5\n",
1946 "87916544/87910968 [==============================] - 5s 0us/step\n",
1947 "__________________________________________________________________________________________________\n",
1948 "Layer (type) Output Shape Param # Connected to \n",
1949 "==================================================================================================\n",
1950 "input_6 (InputLayer) (None, None, None, 3 0 \n",
1951 "__________________________________________________________________________________________________\n",
1952 "conv2d_95 (Conv2D) (None, None, None, 3 864 input_6[0][0] \n",
1953 "__________________________________________________________________________________________________\n",
1954 "batch_normalization_95 (BatchNo (None, None, None, 3 96 conv2d_95[0][0] \n",
1955 "__________________________________________________________________________________________________\n",
1956 "activation_193 (Activation) (None, None, None, 3 0 batch_normalization_95[0][0] \n",
1957 "__________________________________________________________________________________________________\n",
1958 "conv2d_96 (Conv2D) (None, None, None, 3 9216 activation_193[0][0] \n",
1959 "__________________________________________________________________________________________________\n",
1960 "batch_normalization_96 (BatchNo (None, None, None, 3 96 conv2d_96[0][0] \n",
1961 "__________________________________________________________________________________________________\n",
1962 "activation_194 (Activation) (None, None, None, 3 0 batch_normalization_96[0][0] \n",
1963 "__________________________________________________________________________________________________\n",
1964 "conv2d_97 (Conv2D) (None, None, None, 6 18432 activation_194[0][0] \n",
1965 "__________________________________________________________________________________________________\n",
1966 "batch_normalization_97 (BatchNo (None, None, None, 6 192 conv2d_97[0][0] \n",
1967 "__________________________________________________________________________________________________\n",
1968 "activation_195 (Activation) (None, None, None, 6 0 batch_normalization_97[0][0] \n",
1969 "__________________________________________________________________________________________________\n",
1970 "max_pooling2d_7 (MaxPooling2D) (None, None, None, 6 0 activation_195[0][0] \n",
1971 "__________________________________________________________________________________________________\n",
1972 "conv2d_98 (Conv2D) (None, None, None, 8 5120 max_pooling2d_7[0][0] \n",
1973 "__________________________________________________________________________________________________\n",
1974 "batch_normalization_98 (BatchNo (None, None, None, 8 240 conv2d_98[0][0] \n",
1975 "__________________________________________________________________________________________________\n",
1976 "activation_196 (Activation) (None, None, None, 8 0 batch_normalization_98[0][0] \n",
1977 "__________________________________________________________________________________________________\n",
1978 "conv2d_99 (Conv2D) (None, None, None, 1 138240 activation_196[0][0] \n",
1979 "__________________________________________________________________________________________________\n",
1980 "batch_normalization_99 (BatchNo (None, None, None, 1 576 conv2d_99[0][0] \n",
1981 "__________________________________________________________________________________________________\n",
1982 "activation_197 (Activation) (None, None, None, 1 0 batch_normalization_99[0][0] \n",
1983 "__________________________________________________________________________________________________\n",
1984 "max_pooling2d_8 (MaxPooling2D) (None, None, None, 1 0 activation_197[0][0] \n",
1985 "__________________________________________________________________________________________________\n",
1986 "conv2d_103 (Conv2D) (None, None, None, 6 12288 max_pooling2d_8[0][0] \n",
1987 "__________________________________________________________________________________________________\n",
1988 "batch_normalization_103 (BatchN (None, None, None, 6 192 conv2d_103[0][0] \n",
1989 "__________________________________________________________________________________________________\n",
1990 "activation_201 (Activation) (None, None, None, 6 0 batch_normalization_103[0][0] \n",
1991 "__________________________________________________________________________________________________\n",
1992 "conv2d_101 (Conv2D) (None, None, None, 4 9216 max_pooling2d_8[0][0] \n",
1993 "__________________________________________________________________________________________________\n",
1994 "conv2d_104 (Conv2D) (None, None, None, 9 55296 activation_201[0][0] \n",
1995 "__________________________________________________________________________________________________\n",
1996 "batch_normalization_101 (BatchN (None, None, None, 4 144 conv2d_101[0][0] \n",
1997 "__________________________________________________________________________________________________\n",
1998 "batch_normalization_104 (BatchN (None, None, None, 9 288 conv2d_104[0][0] \n",
1999 "__________________________________________________________________________________________________\n",
2000 "activation_199 (Activation) (None, None, None, 4 0 batch_normalization_101[0][0] \n",
2001 "__________________________________________________________________________________________________\n",
2002 "activation_202 (Activation) (None, None, None, 9 0 batch_normalization_104[0][0] \n",
2003 "__________________________________________________________________________________________________\n",
2004 "average_pooling2d_10 (AveragePo (None, None, None, 1 0 max_pooling2d_8[0][0] \n",
2005 "__________________________________________________________________________________________________\n",
2006 "conv2d_100 (Conv2D) (None, None, None, 6 12288 max_pooling2d_8[0][0] \n",
2007 "__________________________________________________________________________________________________\n",
2008 "conv2d_102 (Conv2D) (None, None, None, 6 76800 activation_199[0][0] \n",
2009 "__________________________________________________________________________________________________\n",
2010 "conv2d_105 (Conv2D) (None, None, None, 9 82944 activation_202[0][0] \n",
2011 "__________________________________________________________________________________________________\n",
2012 "conv2d_106 (Conv2D) (None, None, None, 3 6144 average_pooling2d_10[0][0] \n",
2013 "__________________________________________________________________________________________________\n",
2014 "batch_normalization_100 (BatchN (None, None, None, 6 192 conv2d_100[0][0] \n",
2015 "__________________________________________________________________________________________________\n",
2016 "batch_normalization_102 (BatchN (None, None, None, 6 192 conv2d_102[0][0] \n",
2017 "__________________________________________________________________________________________________\n",
2018 "batch_normalization_105 (BatchN (None, None, None, 9 288 conv2d_105[0][0] \n",
2019 "__________________________________________________________________________________________________\n",
2020 "batch_normalization_106 (BatchN (None, None, None, 3 96 conv2d_106[0][0] \n",
2021 "__________________________________________________________________________________________________\n",
2022 "activation_198 (Activation) (None, None, None, 6 0 batch_normalization_100[0][0] \n",
2023 "__________________________________________________________________________________________________\n",
2024 "activation_200 (Activation) (None, None, None, 6 0 batch_normalization_102[0][0] \n",
2025 "__________________________________________________________________________________________________\n",
2026 "activation_203 (Activation) (None, None, None, 9 0 batch_normalization_105[0][0] \n",
2027 "__________________________________________________________________________________________________\n",
2028 "activation_204 (Activation) (None, None, None, 3 0 batch_normalization_106[0][0] \n",
2029 "__________________________________________________________________________________________________\n",
2030 "mixed0 (Concatenate) (None, None, None, 2 0 activation_198[0][0] \n",
2031 " activation_200[0][0] \n",
2032 " activation_203[0][0] \n",
2033 " activation_204[0][0] \n",
2034 "__________________________________________________________________________________________________\n",
2035 "conv2d_110 (Conv2D) (None, None, None, 6 16384 mixed0[0][0] \n",
2036 "__________________________________________________________________________________________________\n",
2037 "batch_normalization_110 (BatchN (None, None, None, 6 192 conv2d_110[0][0] \n",
2038 "__________________________________________________________________________________________________\n",
2039 "activation_208 (Activation) (None, None, None, 6 0 batch_normalization_110[0][0] \n",
2040 "__________________________________________________________________________________________________\n",
2041 "conv2d_108 (Conv2D) (None, None, None, 4 12288 mixed0[0][0] \n",
2042 "__________________________________________________________________________________________________\n",
2043 "conv2d_111 (Conv2D) (None, None, None, 9 55296 activation_208[0][0] \n",
2044 "__________________________________________________________________________________________________\n",
2045 "batch_normalization_108 (BatchN (None, None, None, 4 144 conv2d_108[0][0] \n",
2046 "__________________________________________________________________________________________________\n",
2047 "batch_normalization_111 (BatchN (None, None, None, 9 288 conv2d_111[0][0] \n",
2048 "__________________________________________________________________________________________________\n",
2049 "activation_206 (Activation) (None, None, None, 4 0 batch_normalization_108[0][0] \n",
2050 "__________________________________________________________________________________________________\n",
2051 "activation_209 (Activation) (None, None, None, 9 0 batch_normalization_111[0][0] \n",
2052 "__________________________________________________________________________________________________\n",
2053 "average_pooling2d_11 (AveragePo (None, None, None, 2 0 mixed0[0][0] \n",
2054 "__________________________________________________________________________________________________\n",
2055 "conv2d_107 (Conv2D) (None, None, None, 6 16384 mixed0[0][0] \n",
2056 "__________________________________________________________________________________________________\n",
2057 "conv2d_109 (Conv2D) (None, None, None, 6 76800 activation_206[0][0] \n",
2058 "__________________________________________________________________________________________________\n",
2059 "conv2d_112 (Conv2D) (None, None, None, 9 82944 activation_209[0][0] \n",
2060 "__________________________________________________________________________________________________\n",
2061 "conv2d_113 (Conv2D) (None, None, None, 6 16384 average_pooling2d_11[0][0] \n",
2062 "__________________________________________________________________________________________________\n",
2063 "batch_normalization_107 (BatchN (None, None, None, 6 192 conv2d_107[0][0] \n",
2064 "__________________________________________________________________________________________________\n",
2065 "batch_normalization_109 (BatchN (None, None, None, 6 192 conv2d_109[0][0] \n",
2066 "__________________________________________________________________________________________________\n",
2067 "batch_normalization_112 (BatchN (None, None, None, 9 288 conv2d_112[0][0] \n",
2068 "__________________________________________________________________________________________________\n",
2069 "batch_normalization_113 (BatchN (None, None, None, 6 192 conv2d_113[0][0] \n",
2070 "__________________________________________________________________________________________________\n",
2071 "activation_205 (Activation) (None, None, None, 6 0 batch_normalization_107[0][0] \n",
2072 "__________________________________________________________________________________________________\n",
2073 "activation_207 (Activation) (None, None, None, 6 0 batch_normalization_109[0][0] \n",
2074 "__________________________________________________________________________________________________\n",
2075 "activation_210 (Activation) (None, None, None, 9 0 batch_normalization_112[0][0] \n",
2076 "__________________________________________________________________________________________________\n",
2077 "activation_211 (Activation) (None, None, None, 6 0 batch_normalization_113[0][0] \n",
2078 "__________________________________________________________________________________________________\n",
2079 "mixed1 (Concatenate) (None, None, None, 2 0 activation_205[0][0] \n",
2080 " activation_207[0][0] \n",
2081 " activation_210[0][0] \n",
2082 " activation_211[0][0] \n",
2083 "__________________________________________________________________________________________________\n",
2084 "conv2d_117 (Conv2D) (None, None, None, 6 18432 mixed1[0][0] \n",
2085 "__________________________________________________________________________________________________\n",
2086 "batch_normalization_117 (BatchN (None, None, None, 6 192 conv2d_117[0][0] \n",
2087 "__________________________________________________________________________________________________\n",
2088 "activation_215 (Activation) (None, None, None, 6 0 batch_normalization_117[0][0] \n",
2089 "__________________________________________________________________________________________________\n",
2090 "conv2d_115 (Conv2D) (None, None, None, 4 13824 mixed1[0][0] \n",
2091 "__________________________________________________________________________________________________\n",
2092 "conv2d_118 (Conv2D) (None, None, None, 9 55296 activation_215[0][0] \n",
2093 "__________________________________________________________________________________________________\n",
2094 "batch_normalization_115 (BatchN (None, None, None, 4 144 conv2d_115[0][0] \n",
2095 "__________________________________________________________________________________________________\n",
2096 "batch_normalization_118 (BatchN (None, None, None, 9 288 conv2d_118[0][0] \n",
2097 "__________________________________________________________________________________________________\n",
2098 "activation_213 (Activation) (None, None, None, 4 0 batch_normalization_115[0][0] \n",
2099 "__________________________________________________________________________________________________\n",
2100 "activation_216 (Activation) (None, None, None, 9 0 batch_normalization_118[0][0] \n",
2101 "__________________________________________________________________________________________________\n",
2102 "average_pooling2d_12 (AveragePo (None, None, None, 2 0 mixed1[0][0] \n",
2103 "__________________________________________________________________________________________________\n",
2104 "conv2d_114 (Conv2D) (None, None, None, 6 18432 mixed1[0][0] \n",
2105 "__________________________________________________________________________________________________\n",
2106 "conv2d_116 (Conv2D) (None, None, None, 6 76800 activation_213[0][0] \n",
2107 "__________________________________________________________________________________________________\n",
2108 "conv2d_119 (Conv2D) (None, None, None, 9 82944 activation_216[0][0] \n",
2109 "__________________________________________________________________________________________________\n",
2110 "conv2d_120 (Conv2D) (None, None, None, 6 18432 average_pooling2d_12[0][0] \n",
2111 "__________________________________________________________________________________________________\n",
2112 "batch_normalization_114 (BatchN (None, None, None, 6 192 conv2d_114[0][0] \n",
2113 "__________________________________________________________________________________________________\n",
2114 "batch_normalization_116 (BatchN (None, None, None, 6 192 conv2d_116[0][0] \n",
2115 "__________________________________________________________________________________________________\n",
2116 "batch_normalization_119 (BatchN (None, None, None, 9 288 conv2d_119[0][0] \n",
2117 "__________________________________________________________________________________________________\n",
2118 "batch_normalization_120 (BatchN (None, None, None, 6 192 conv2d_120[0][0] \n",
2119 "__________________________________________________________________________________________________\n",
2120 "activation_212 (Activation) (None, None, None, 6 0 batch_normalization_114[0][0] \n",
2121 "__________________________________________________________________________________________________\n",
2122 "activation_214 (Activation) (None, None, None, 6 0 batch_normalization_116[0][0] \n",
2123 "__________________________________________________________________________________________________\n",
2124 "activation_217 (Activation) (None, None, None, 9 0 batch_normalization_119[0][0] \n",
2125 "__________________________________________________________________________________________________\n",
2126 "activation_218 (Activation) (None, None, None, 6 0 batch_normalization_120[0][0] \n",
2127 "__________________________________________________________________________________________________\n",
2128 "mixed2 (Concatenate) (None, None, None, 2 0 activation_212[0][0] \n",
2129 " activation_214[0][0] \n",
2130 " activation_217[0][0] \n",
2131 " activation_218[0][0] \n",
2132 "__________________________________________________________________________________________________\n",
2133 "conv2d_122 (Conv2D) (None, None, None, 6 18432 mixed2[0][0] \n",
2134 "__________________________________________________________________________________________________\n",
2135 "batch_normalization_122 (BatchN (None, None, None, 6 192 conv2d_122[0][0] \n",
2136 "__________________________________________________________________________________________________\n",
2137 "activation_220 (Activation) (None, None, None, 6 0 batch_normalization_122[0][0] \n",
2138 "__________________________________________________________________________________________________\n",
2139 "conv2d_123 (Conv2D) (None, None, None, 9 55296 activation_220[0][0] \n",
2140 "__________________________________________________________________________________________________\n",
2141 "batch_normalization_123 (BatchN (None, None, None, 9 288 conv2d_123[0][0] \n",
2142 "__________________________________________________________________________________________________\n",
2143 "activation_221 (Activation) (None, None, None, 9 0 batch_normalization_123[0][0] \n",
2144 "__________________________________________________________________________________________________\n",
2145 "conv2d_121 (Conv2D) (None, None, None, 3 995328 mixed2[0][0] \n",
2146 "__________________________________________________________________________________________________\n",
2147 "conv2d_124 (Conv2D) (None, None, None, 9 82944 activation_221[0][0] \n",
2148 "__________________________________________________________________________________________________\n",
2149 "batch_normalization_121 (BatchN (None, None, None, 3 1152 conv2d_121[0][0] \n",
2150 "__________________________________________________________________________________________________\n",
2151 "batch_normalization_124 (BatchN (None, None, None, 9 288 conv2d_124[0][0] \n",
2152 "__________________________________________________________________________________________________\n",
2153 "activation_219 (Activation) (None, None, None, 3 0 batch_normalization_121[0][0] \n",
2154 "__________________________________________________________________________________________________\n",
2155 "activation_222 (Activation) (None, None, None, 9 0 batch_normalization_124[0][0] \n",
2156 "__________________________________________________________________________________________________\n",
2157 "max_pooling2d_9 (MaxPooling2D) (None, None, None, 2 0 mixed2[0][0] \n",
2158 "__________________________________________________________________________________________________\n",
2159 "mixed3 (Concatenate) (None, None, None, 7 0 activation_219[0][0] \n",
2160 " activation_222[0][0] \n",
2161 " max_pooling2d_9[0][0] \n",
2162 "__________________________________________________________________________________________________\n",
2163 "conv2d_129 (Conv2D) (None, None, None, 1 98304 mixed3[0][0] \n",
2164 "__________________________________________________________________________________________________\n",
2165 "batch_normalization_129 (BatchN (None, None, None, 1 384 conv2d_129[0][0] \n",
2166 "__________________________________________________________________________________________________\n",
2167 "activation_227 (Activation) (None, None, None, 1 0 batch_normalization_129[0][0] \n",
2168 "__________________________________________________________________________________________________\n",
2169 "conv2d_130 (Conv2D) (None, None, None, 1 114688 activation_227[0][0] \n",
2170 "__________________________________________________________________________________________________\n",
2171 "batch_normalization_130 (BatchN (None, None, None, 1 384 conv2d_130[0][0] \n",
2172 "__________________________________________________________________________________________________\n",
2173 "activation_228 (Activation) (None, None, None, 1 0 batch_normalization_130[0][0] \n",
2174 "__________________________________________________________________________________________________\n",
2175 "conv2d_126 (Conv2D) (None, None, None, 1 98304 mixed3[0][0] \n",
2176 "__________________________________________________________________________________________________\n",
2177 "conv2d_131 (Conv2D) (None, None, None, 1 114688 activation_228[0][0] \n",
2178 "__________________________________________________________________________________________________\n",
2179 "batch_normalization_126 (BatchN (None, None, None, 1 384 conv2d_126[0][0] \n",
2180 "__________________________________________________________________________________________________\n",
2181 "batch_normalization_131 (BatchN (None, None, None, 1 384 conv2d_131[0][0] \n",
2182 "__________________________________________________________________________________________________\n",
2183 "activation_224 (Activation) (None, None, None, 1 0 batch_normalization_126[0][0] \n",
2184 "__________________________________________________________________________________________________\n",
2185 "activation_229 (Activation) (None, None, None, 1 0 batch_normalization_131[0][0] \n",
2186 "__________________________________________________________________________________________________\n",
2187 "conv2d_127 (Conv2D) (None, None, None, 1 114688 activation_224[0][0] \n",
2188 "__________________________________________________________________________________________________\n",
2189 "conv2d_132 (Conv2D) (None, None, None, 1 114688 activation_229[0][0] \n",
2190 "__________________________________________________________________________________________________\n",
2191 "batch_normalization_127 (BatchN (None, None, None, 1 384 conv2d_127[0][0] \n",
2192 "__________________________________________________________________________________________________\n",
2193 "batch_normalization_132 (BatchN (None, None, None, 1 384 conv2d_132[0][0] \n",
2194 "__________________________________________________________________________________________________\n",
2195 "activation_225 (Activation) (None, None, None, 1 0 batch_normalization_127[0][0] \n",
2196 "__________________________________________________________________________________________________\n",
2197 "activation_230 (Activation) (None, None, None, 1 0 batch_normalization_132[0][0] \n",
2198 "__________________________________________________________________________________________________\n",
2199 "average_pooling2d_13 (AveragePo (None, None, None, 7 0 mixed3[0][0] \n",
2200 "__________________________________________________________________________________________________\n",
2201 "conv2d_125 (Conv2D) (None, None, None, 1 147456 mixed3[0][0] \n",
2202 "__________________________________________________________________________________________________\n",
2203 "conv2d_128 (Conv2D) (None, None, None, 1 172032 activation_225[0][0] \n",
2204 "__________________________________________________________________________________________________\n",
2205 "conv2d_133 (Conv2D) (None, None, None, 1 172032 activation_230[0][0] \n",
2206 "__________________________________________________________________________________________________\n",
2207 "conv2d_134 (Conv2D) (None, None, None, 1 147456 average_pooling2d_13[0][0] \n",
2208 "__________________________________________________________________________________________________\n",
2209 "batch_normalization_125 (BatchN (None, None, None, 1 576 conv2d_125[0][0] \n",
2210 "__________________________________________________________________________________________________\n",
2211 "batch_normalization_128 (BatchN (None, None, None, 1 576 conv2d_128[0][0] \n",
2212 "__________________________________________________________________________________________________\n",
2213 "batch_normalization_133 (BatchN (None, None, None, 1 576 conv2d_133[0][0] \n",
2214 "__________________________________________________________________________________________________\n",
2215 "batch_normalization_134 (BatchN (None, None, None, 1 576 conv2d_134[0][0] \n",
2216 "__________________________________________________________________________________________________\n",
2217 "activation_223 (Activation) (None, None, None, 1 0 batch_normalization_125[0][0] \n",
2218 "__________________________________________________________________________________________________\n",
2219 "activation_226 (Activation) (None, None, None, 1 0 batch_normalization_128[0][0] \n",
2220 "__________________________________________________________________________________________________\n",
2221 "activation_231 (Activation) (None, None, None, 1 0 batch_normalization_133[0][0] \n",
2222 "__________________________________________________________________________________________________\n",
2223 "activation_232 (Activation) (None, None, None, 1 0 batch_normalization_134[0][0] \n",
2224 "__________________________________________________________________________________________________\n",
2225 "mixed4 (Concatenate) (None, None, None, 7 0 activation_223[0][0] \n",
2226 " activation_226[0][0] \n",
2227 " activation_231[0][0] \n",
2228 " activation_232[0][0] \n",
2229 "__________________________________________________________________________________________________\n",
2230 "conv2d_139 (Conv2D) (None, None, None, 1 122880 mixed4[0][0] \n",
2231 "__________________________________________________________________________________________________\n",
2232 "batch_normalization_139 (BatchN (None, None, None, 1 480 conv2d_139[0][0] \n",
2233 "__________________________________________________________________________________________________\n",
2234 "activation_237 (Activation) (None, None, None, 1 0 batch_normalization_139[0][0] \n",
2235 "__________________________________________________________________________________________________\n",
2236 "conv2d_140 (Conv2D) (None, None, None, 1 179200 activation_237[0][0] \n",
2237 "__________________________________________________________________________________________________\n",
2238 "batch_normalization_140 (BatchN (None, None, None, 1 480 conv2d_140[0][0] \n",
2239 "__________________________________________________________________________________________________\n",
2240 "activation_238 (Activation) (None, None, None, 1 0 batch_normalization_140[0][0] \n",
2241 "__________________________________________________________________________________________________\n",
2242 "conv2d_136 (Conv2D) (None, None, None, 1 122880 mixed4[0][0] \n",
2243 "__________________________________________________________________________________________________\n",
2244 "conv2d_141 (Conv2D) (None, None, None, 1 179200 activation_238[0][0] \n",
2245 "__________________________________________________________________________________________________\n",
2246 "batch_normalization_136 (BatchN (None, None, None, 1 480 conv2d_136[0][0] \n",
2247 "__________________________________________________________________________________________________\n",
2248 "batch_normalization_141 (BatchN (None, None, None, 1 480 conv2d_141[0][0] \n",
2249 "__________________________________________________________________________________________________\n",
2250 "activation_234 (Activation) (None, None, None, 1 0 batch_normalization_136[0][0] \n",
2251 "__________________________________________________________________________________________________\n",
2252 "activation_239 (Activation) (None, None, None, 1 0 batch_normalization_141[0][0] \n",
2253 "__________________________________________________________________________________________________\n",
2254 "conv2d_137 (Conv2D) (None, None, None, 1 179200 activation_234[0][0] \n",
2255 "__________________________________________________________________________________________________\n",
2256 "conv2d_142 (Conv2D) (None, None, None, 1 179200 activation_239[0][0] \n",
2257 "__________________________________________________________________________________________________\n",
2258 "batch_normalization_137 (BatchN (None, None, None, 1 480 conv2d_137[0][0] \n",
2259 "__________________________________________________________________________________________________\n",
2260 "batch_normalization_142 (BatchN (None, None, None, 1 480 conv2d_142[0][0] \n",
2261 "__________________________________________________________________________________________________\n",
2262 "activation_235 (Activation) (None, None, None, 1 0 batch_normalization_137[0][0] \n",
2263 "__________________________________________________________________________________________________\n",
2264 "activation_240 (Activation) (None, None, None, 1 0 batch_normalization_142[0][0] \n",
2265 "__________________________________________________________________________________________________\n",
2266 "average_pooling2d_14 (AveragePo (None, None, None, 7 0 mixed4[0][0] \n",
2267 "__________________________________________________________________________________________________\n",
2268 "conv2d_135 (Conv2D) (None, None, None, 1 147456 mixed4[0][0] \n",
2269 "__________________________________________________________________________________________________\n",
2270 "conv2d_138 (Conv2D) (None, None, None, 1 215040 activation_235[0][0] \n",
2271 "__________________________________________________________________________________________________\n",
2272 "conv2d_143 (Conv2D) (None, None, None, 1 215040 activation_240[0][0] \n",
2273 "__________________________________________________________________________________________________\n",
2274 "conv2d_144 (Conv2D) (None, None, None, 1 147456 average_pooling2d_14[0][0] \n",
2275 "__________________________________________________________________________________________________\n",
2276 "batch_normalization_135 (BatchN (None, None, None, 1 576 conv2d_135[0][0] \n",
2277 "__________________________________________________________________________________________________\n",
2278 "batch_normalization_138 (BatchN (None, None, None, 1 576 conv2d_138[0][0] \n",
2279 "__________________________________________________________________________________________________\n",
2280 "batch_normalization_143 (BatchN (None, None, None, 1 576 conv2d_143[0][0] \n",
2281 "__________________________________________________________________________________________________\n",
2282 "batch_normalization_144 (BatchN (None, None, None, 1 576 conv2d_144[0][0] \n",
2283 "__________________________________________________________________________________________________\n",
2284 "activation_233 (Activation) (None, None, None, 1 0 batch_normalization_135[0][0] \n",
2285 "__________________________________________________________________________________________________\n",
2286 "activation_236 (Activation) (None, None, None, 1 0 batch_normalization_138[0][0] \n",
2287 "__________________________________________________________________________________________________\n",
2288 "activation_241 (Activation) (None, None, None, 1 0 batch_normalization_143[0][0] \n",
2289 "__________________________________________________________________________________________________\n",
2290 "activation_242 (Activation) (None, None, None, 1 0 batch_normalization_144[0][0] \n",
2291 "__________________________________________________________________________________________________\n",
2292 "mixed5 (Concatenate) (None, None, None, 7 0 activation_233[0][0] \n",
2293 " activation_236[0][0] \n",
2294 " activation_241[0][0] \n",
2295 " activation_242[0][0] \n",
2296 "__________________________________________________________________________________________________\n",
2297 "conv2d_149 (Conv2D) (None, None, None, 1 122880 mixed5[0][0] \n",
2298 "__________________________________________________________________________________________________\n",
2299 "batch_normalization_149 (BatchN (None, None, None, 1 480 conv2d_149[0][0] \n",
2300 "__________________________________________________________________________________________________\n",
2301 "activation_247 (Activation) (None, None, None, 1 0 batch_normalization_149[0][0] \n",
2302 "__________________________________________________________________________________________________\n",
2303 "conv2d_150 (Conv2D) (None, None, None, 1 179200 activation_247[0][0] \n",
2304 "__________________________________________________________________________________________________\n",
2305 "batch_normalization_150 (BatchN (None, None, None, 1 480 conv2d_150[0][0] \n",
2306 "__________________________________________________________________________________________________\n",
2307 "activation_248 (Activation) (None, None, None, 1 0 batch_normalization_150[0][0] \n",
2308 "__________________________________________________________________________________________________\n",
2309 "conv2d_146 (Conv2D) (None, None, None, 1 122880 mixed5[0][0] \n",
2310 "__________________________________________________________________________________________________\n",
2311 "conv2d_151 (Conv2D) (None, None, None, 1 179200 activation_248[0][0] \n",
2312 "__________________________________________________________________________________________________\n",
2313 "batch_normalization_146 (BatchN (None, None, None, 1 480 conv2d_146[0][0] \n",
2314 "__________________________________________________________________________________________________\n",
2315 "batch_normalization_151 (BatchN (None, None, None, 1 480 conv2d_151[0][0] \n",
2316 "__________________________________________________________________________________________________\n",
2317 "activation_244 (Activation) (None, None, None, 1 0 batch_normalization_146[0][0] \n",
2318 "__________________________________________________________________________________________________\n",
2319 "activation_249 (Activation) (None, None, None, 1 0 batch_normalization_151[0][0] \n",
2320 "__________________________________________________________________________________________________\n",
2321 "conv2d_147 (Conv2D) (None, None, None, 1 179200 activation_244[0][0] \n",
2322 "__________________________________________________________________________________________________\n",
2323 "conv2d_152 (Conv2D) (None, None, None, 1 179200 activation_249[0][0] \n",
2324 "__________________________________________________________________________________________________\n",
2325 "batch_normalization_147 (BatchN (None, None, None, 1 480 conv2d_147[0][0] \n",
2326 "__________________________________________________________________________________________________\n",
2327 "batch_normalization_152 (BatchN (None, None, None, 1 480 conv2d_152[0][0] \n",
2328 "__________________________________________________________________________________________________\n",
2329 "activation_245 (Activation) (None, None, None, 1 0 batch_normalization_147[0][0] \n",
2330 "__________________________________________________________________________________________________\n",
2331 "activation_250 (Activation) (None, None, None, 1 0 batch_normalization_152[0][0] \n",
2332 "__________________________________________________________________________________________________\n",
2333 "average_pooling2d_15 (AveragePo (None, None, None, 7 0 mixed5[0][0] \n",
2334 "__________________________________________________________________________________________________\n",
2335 "conv2d_145 (Conv2D) (None, None, None, 1 147456 mixed5[0][0] \n",
2336 "__________________________________________________________________________________________________\n",
2337 "conv2d_148 (Conv2D) (None, None, None, 1 215040 activation_245[0][0] \n",
2338 "__________________________________________________________________________________________________\n",
2339 "conv2d_153 (Conv2D) (None, None, None, 1 215040 activation_250[0][0] \n",
2340 "__________________________________________________________________________________________________\n",
2341 "conv2d_154 (Conv2D) (None, None, None, 1 147456 average_pooling2d_15[0][0] \n",
2342 "__________________________________________________________________________________________________\n",
2343 "batch_normalization_145 (BatchN (None, None, None, 1 576 conv2d_145[0][0] \n",
2344 "__________________________________________________________________________________________________\n",
2345 "batch_normalization_148 (BatchN (None, None, None, 1 576 conv2d_148[0][0] \n",
2346 "__________________________________________________________________________________________________\n",
2347 "batch_normalization_153 (BatchN (None, None, None, 1 576 conv2d_153[0][0] \n",
2348 "__________________________________________________________________________________________________\n",
2349 "batch_normalization_154 (BatchN (None, None, None, 1 576 conv2d_154[0][0] \n",
2350 "__________________________________________________________________________________________________\n",
2351 "activation_243 (Activation) (None, None, None, 1 0 batch_normalization_145[0][0] \n",
2352 "__________________________________________________________________________________________________\n",
2353 "activation_246 (Activation) (None, None, None, 1 0 batch_normalization_148[0][0] \n",
2354 "__________________________________________________________________________________________________\n",
2355 "activation_251 (Activation) (None, None, None, 1 0 batch_normalization_153[0][0] \n",
2356 "__________________________________________________________________________________________________\n",
2357 "activation_252 (Activation) (None, None, None, 1 0 batch_normalization_154[0][0] \n",
2358 "__________________________________________________________________________________________________\n",
2359 "mixed6 (Concatenate) (None, None, None, 7 0 activation_243[0][0] \n",
2360 " activation_246[0][0] \n",
2361 " activation_251[0][0] \n",
2362 " activation_252[0][0] \n",
2363 "__________________________________________________________________________________________________\n",
2364 "conv2d_159 (Conv2D) (None, None, None, 1 147456 mixed6[0][0] \n",
2365 "__________________________________________________________________________________________________\n",
2366 "batch_normalization_159 (BatchN (None, None, None, 1 576 conv2d_159[0][0] \n",
2367 "__________________________________________________________________________________________________\n",
2368 "activation_257 (Activation) (None, None, None, 1 0 batch_normalization_159[0][0] \n",
2369 "__________________________________________________________________________________________________\n",
2370 "conv2d_160 (Conv2D) (None, None, None, 1 258048 activation_257[0][0] \n",
2371 "__________________________________________________________________________________________________\n",
2372 "batch_normalization_160 (BatchN (None, None, None, 1 576 conv2d_160[0][0] \n",
2373 "__________________________________________________________________________________________________\n",
2374 "activation_258 (Activation) (None, None, None, 1 0 batch_normalization_160[0][0] \n",
2375 "__________________________________________________________________________________________________\n",
2376 "conv2d_156 (Conv2D) (None, None, None, 1 147456 mixed6[0][0] \n",
2377 "__________________________________________________________________________________________________\n",
2378 "conv2d_161 (Conv2D) (None, None, None, 1 258048 activation_258[0][0] \n",
2379 "__________________________________________________________________________________________________\n",
2380 "batch_normalization_156 (BatchN (None, None, None, 1 576 conv2d_156[0][0] \n",
2381 "__________________________________________________________________________________________________\n",
2382 "batch_normalization_161 (BatchN (None, None, None, 1 576 conv2d_161[0][0] \n",
2383 "__________________________________________________________________________________________________\n",
2384 "activation_254 (Activation) (None, None, None, 1 0 batch_normalization_156[0][0] \n",
2385 "__________________________________________________________________________________________________\n",
2386 "activation_259 (Activation) (None, None, None, 1 0 batch_normalization_161[0][0] \n",
2387 "__________________________________________________________________________________________________\n",
2388 "conv2d_157 (Conv2D) (None, None, None, 1 258048 activation_254[0][0] \n",
2389 "__________________________________________________________________________________________________\n",
2390 "conv2d_162 (Conv2D) (None, None, None, 1 258048 activation_259[0][0] \n",
2391 "__________________________________________________________________________________________________\n",
2392 "batch_normalization_157 (BatchN (None, None, None, 1 576 conv2d_157[0][0] \n",
2393 "__________________________________________________________________________________________________\n",
2394 "batch_normalization_162 (BatchN (None, None, None, 1 576 conv2d_162[0][0] \n",
2395 "__________________________________________________________________________________________________\n",
2396 "activation_255 (Activation) (None, None, None, 1 0 batch_normalization_157[0][0] \n",
2397 "__________________________________________________________________________________________________\n",
2398 "activation_260 (Activation) (None, None, None, 1 0 batch_normalization_162[0][0] \n",
2399 "__________________________________________________________________________________________________\n",
2400 "average_pooling2d_16 (AveragePo (None, None, None, 7 0 mixed6[0][0] \n",
2401 "__________________________________________________________________________________________________\n",
2402 "conv2d_155 (Conv2D) (None, None, None, 1 147456 mixed6[0][0] \n",
2403 "__________________________________________________________________________________________________\n",
2404 "conv2d_158 (Conv2D) (None, None, None, 1 258048 activation_255[0][0] \n",
2405 "__________________________________________________________________________________________________\n",
2406 "conv2d_163 (Conv2D) (None, None, None, 1 258048 activation_260[0][0] \n",
2407 "__________________________________________________________________________________________________\n",
2408 "conv2d_164 (Conv2D) (None, None, None, 1 147456 average_pooling2d_16[0][0] \n",
2409 "__________________________________________________________________________________________________\n",
2410 "batch_normalization_155 (BatchN (None, None, None, 1 576 conv2d_155[0][0] \n",
2411 "__________________________________________________________________________________________________\n",
2412 "batch_normalization_158 (BatchN (None, None, None, 1 576 conv2d_158[0][0] \n",
2413 "__________________________________________________________________________________________________\n",
2414 "batch_normalization_163 (BatchN (None, None, None, 1 576 conv2d_163[0][0] \n",
2415 "__________________________________________________________________________________________________\n",
2416 "batch_normalization_164 (BatchN (None, None, None, 1 576 conv2d_164[0][0] \n",
2417 "__________________________________________________________________________________________________\n",
2418 "activation_253 (Activation) (None, None, None, 1 0 batch_normalization_155[0][0] \n",
2419 "__________________________________________________________________________________________________\n",
2420 "activation_256 (Activation) (None, None, None, 1 0 batch_normalization_158[0][0] \n",
2421 "__________________________________________________________________________________________________\n",
2422 "activation_261 (Activation) (None, None, None, 1 0 batch_normalization_163[0][0] \n",
2423 "__________________________________________________________________________________________________\n",
2424 "activation_262 (Activation) (None, None, None, 1 0 batch_normalization_164[0][0] \n",
2425 "__________________________________________________________________________________________________\n",
2426 "mixed7 (Concatenate) (None, None, None, 7 0 activation_253[0][0] \n",
2427 " activation_256[0][0] \n",
2428 " activation_261[0][0] \n",
2429 " activation_262[0][0] \n",
2430 "__________________________________________________________________________________________________\n",
2431 "conv2d_167 (Conv2D) (None, None, None, 1 147456 mixed7[0][0] \n",
2432 "__________________________________________________________________________________________________\n",
2433 "batch_normalization_167 (BatchN (None, None, None, 1 576 conv2d_167[0][0] \n",
2434 "__________________________________________________________________________________________________\n",
2435 "activation_265 (Activation) (None, None, None, 1 0 batch_normalization_167[0][0] \n",
2436 "__________________________________________________________________________________________________\n",
2437 "conv2d_168 (Conv2D) (None, None, None, 1 258048 activation_265[0][0] \n",
2438 "__________________________________________________________________________________________________\n",
2439 "batch_normalization_168 (BatchN (None, None, None, 1 576 conv2d_168[0][0] \n",
2440 "__________________________________________________________________________________________________\n",
2441 "activation_266 (Activation) (None, None, None, 1 0 batch_normalization_168[0][0] \n",
2442 "__________________________________________________________________________________________________\n",
2443 "conv2d_165 (Conv2D) (None, None, None, 1 147456 mixed7[0][0] \n",
2444 "__________________________________________________________________________________________________\n",
2445 "conv2d_169 (Conv2D) (None, None, None, 1 258048 activation_266[0][0] \n",
2446 "__________________________________________________________________________________________________\n",
2447 "batch_normalization_165 (BatchN (None, None, None, 1 576 conv2d_165[0][0] \n",
2448 "__________________________________________________________________________________________________\n",
2449 "batch_normalization_169 (BatchN (None, None, None, 1 576 conv2d_169[0][0] \n",
2450 "__________________________________________________________________________________________________\n",
2451 "activation_263 (Activation) (None, None, None, 1 0 batch_normalization_165[0][0] \n",
2452 "__________________________________________________________________________________________________\n",
2453 "activation_267 (Activation) (None, None, None, 1 0 batch_normalization_169[0][0] \n",
2454 "__________________________________________________________________________________________________\n",
2455 "conv2d_166 (Conv2D) (None, None, None, 3 552960 activation_263[0][0] \n",
2456 "__________________________________________________________________________________________________\n",
2457 "conv2d_170 (Conv2D) (None, None, None, 1 331776 activation_267[0][0] \n",
2458 "__________________________________________________________________________________________________\n",
2459 "batch_normalization_166 (BatchN (None, None, None, 3 960 conv2d_166[0][0] \n",
2460 "__________________________________________________________________________________________________\n",
2461 "batch_normalization_170 (BatchN (None, None, None, 1 576 conv2d_170[0][0] \n",
2462 "__________________________________________________________________________________________________\n",
2463 "activation_264 (Activation) (None, None, None, 3 0 batch_normalization_166[0][0] \n",
2464 "__________________________________________________________________________________________________\n",
2465 "activation_268 (Activation) (None, None, None, 1 0 batch_normalization_170[0][0] \n",
2466 "__________________________________________________________________________________________________\n",
2467 "max_pooling2d_10 (MaxPooling2D) (None, None, None, 7 0 mixed7[0][0] \n",
2468 "__________________________________________________________________________________________________\n",
2469 "mixed8 (Concatenate) (None, None, None, 1 0 activation_264[0][0] \n",
2470 " activation_268[0][0] \n",
2471 " max_pooling2d_10[0][0] \n",
2472 "__________________________________________________________________________________________________\n",
2473 "conv2d_175 (Conv2D) (None, None, None, 4 573440 mixed8[0][0] \n",
2474 "__________________________________________________________________________________________________\n",
2475 "batch_normalization_175 (BatchN (None, None, None, 4 1344 conv2d_175[0][0] \n",
2476 "__________________________________________________________________________________________________\n",
2477 "activation_273 (Activation) (None, None, None, 4 0 batch_normalization_175[0][0] \n",
2478 "__________________________________________________________________________________________________\n",
2479 "conv2d_172 (Conv2D) (None, None, None, 3 491520 mixed8[0][0] \n",
2480 "__________________________________________________________________________________________________\n",
2481 "conv2d_176 (Conv2D) (None, None, None, 3 1548288 activation_273[0][0] \n",
2482 "__________________________________________________________________________________________________\n",
2483 "batch_normalization_172 (BatchN (None, None, None, 3 1152 conv2d_172[0][0] \n",
2484 "__________________________________________________________________________________________________\n",
2485 "batch_normalization_176 (BatchN (None, None, None, 3 1152 conv2d_176[0][0] \n",
2486 "__________________________________________________________________________________________________\n",
2487 "activation_270 (Activation) (None, None, None, 3 0 batch_normalization_172[0][0] \n",
2488 "__________________________________________________________________________________________________\n",
2489 "activation_274 (Activation) (None, None, None, 3 0 batch_normalization_176[0][0] \n",
2490 "__________________________________________________________________________________________________\n",
2491 "conv2d_173 (Conv2D) (None, None, None, 3 442368 activation_270[0][0] \n",
2492 "__________________________________________________________________________________________________\n",
2493 "conv2d_174 (Conv2D) (None, None, None, 3 442368 activation_270[0][0] \n",
2494 "__________________________________________________________________________________________________\n",
2495 "conv2d_177 (Conv2D) (None, None, None, 3 442368 activation_274[0][0] \n",
2496 "__________________________________________________________________________________________________\n",
2497 "conv2d_178 (Conv2D) (None, None, None, 3 442368 activation_274[0][0] \n",
2498 "__________________________________________________________________________________________________\n",
2499 "average_pooling2d_17 (AveragePo (None, None, None, 1 0 mixed8[0][0] \n",
2500 "__________________________________________________________________________________________________\n",
2501 "conv2d_171 (Conv2D) (None, None, None, 3 409600 mixed8[0][0] \n",
2502 "__________________________________________________________________________________________________\n",
2503 "batch_normalization_173 (BatchN (None, None, None, 3 1152 conv2d_173[0][0] \n",
2504 "__________________________________________________________________________________________________\n",
2505 "batch_normalization_174 (BatchN (None, None, None, 3 1152 conv2d_174[0][0] \n",
2506 "__________________________________________________________________________________________________\n",
2507 "batch_normalization_177 (BatchN (None, None, None, 3 1152 conv2d_177[0][0] \n",
2508 "__________________________________________________________________________________________________\n",
2509 "batch_normalization_178 (BatchN (None, None, None, 3 1152 conv2d_178[0][0] \n",
2510 "__________________________________________________________________________________________________\n",
2511 "conv2d_179 (Conv2D) (None, None, None, 1 245760 average_pooling2d_17[0][0] \n",
2512 "__________________________________________________________________________________________________\n",
2513 "batch_normalization_171 (BatchN (None, None, None, 3 960 conv2d_171[0][0] \n",
2514 "__________________________________________________________________________________________________\n",
2515 "activation_271 (Activation) (None, None, None, 3 0 batch_normalization_173[0][0] \n",
2516 "__________________________________________________________________________________________________\n",
2517 "activation_272 (Activation) (None, None, None, 3 0 batch_normalization_174[0][0] \n",
2518 "__________________________________________________________________________________________________\n",
2519 "activation_275 (Activation) (None, None, None, 3 0 batch_normalization_177[0][0] \n",
2520 "__________________________________________________________________________________________________\n",
2521 "activation_276 (Activation) (None, None, None, 3 0 batch_normalization_178[0][0] \n",
2522 "__________________________________________________________________________________________________\n",
2523 "batch_normalization_179 (BatchN (None, None, None, 1 576 conv2d_179[0][0] \n",
2524 "__________________________________________________________________________________________________\n",
2525 "activation_269 (Activation) (None, None, None, 3 0 batch_normalization_171[0][0] \n",
2526 "__________________________________________________________________________________________________\n",
2527 "mixed9_0 (Concatenate) (None, None, None, 7 0 activation_271[0][0] \n",
2528 " activation_272[0][0] \n",
2529 "__________________________________________________________________________________________________\n",
2530 "concatenate_3 (Concatenate) (None, None, None, 7 0 activation_275[0][0] \n",
2531 " activation_276[0][0] \n",
2532 "__________________________________________________________________________________________________\n",
2533 "activation_277 (Activation) (None, None, None, 1 0 batch_normalization_179[0][0] \n",
2534 "__________________________________________________________________________________________________\n",
2535 "mixed9 (Concatenate) (None, None, None, 2 0 activation_269[0][0] \n",
2536 " mixed9_0[0][0] \n",
2537 " concatenate_3[0][0] \n",
2538 " activation_277[0][0] \n",
2539 "__________________________________________________________________________________________________\n",
2540 "conv2d_184 (Conv2D) (None, None, None, 4 917504 mixed9[0][0] \n",
2541 "__________________________________________________________________________________________________\n",
2542 "batch_normalization_184 (BatchN (None, None, None, 4 1344 conv2d_184[0][0] \n",
2543 "__________________________________________________________________________________________________\n",
2544 "activation_282 (Activation) (None, None, None, 4 0 batch_normalization_184[0][0] \n",
2545 "__________________________________________________________________________________________________\n",
2546 "conv2d_181 (Conv2D) (None, None, None, 3 786432 mixed9[0][0] \n",
2547 "__________________________________________________________________________________________________\n",
2548 "conv2d_185 (Conv2D) (None, None, None, 3 1548288 activation_282[0][0] \n",
2549 "__________________________________________________________________________________________________\n",
2550 "batch_normalization_181 (BatchN (None, None, None, 3 1152 conv2d_181[0][0] \n",
2551 "__________________________________________________________________________________________________\n",
2552 "batch_normalization_185 (BatchN (None, None, None, 3 1152 conv2d_185[0][0] \n",
2553 "__________________________________________________________________________________________________\n",
2554 "activation_279 (Activation) (None, None, None, 3 0 batch_normalization_181[0][0] \n",
2555 "__________________________________________________________________________________________________\n",
2556 "activation_283 (Activation) (None, None, None, 3 0 batch_normalization_185[0][0] \n",
2557 "__________________________________________________________________________________________________\n",
2558 "conv2d_182 (Conv2D) (None, None, None, 3 442368 activation_279[0][0] \n",
2559 "__________________________________________________________________________________________________\n",
2560 "conv2d_183 (Conv2D) (None, None, None, 3 442368 activation_279[0][0] \n",
2561 "__________________________________________________________________________________________________\n",
2562 "conv2d_186 (Conv2D) (None, None, None, 3 442368 activation_283[0][0] \n",
2563 "__________________________________________________________________________________________________\n",
2564 "conv2d_187 (Conv2D) (None, None, None, 3 442368 activation_283[0][0] \n",
2565 "__________________________________________________________________________________________________\n",
2566 "average_pooling2d_18 (AveragePo (None, None, None, 2 0 mixed9[0][0] \n",
2567 "__________________________________________________________________________________________________\n",
2568 "conv2d_180 (Conv2D) (None, None, None, 3 655360 mixed9[0][0] \n",
2569 "__________________________________________________________________________________________________\n",
2570 "batch_normalization_182 (BatchN (None, None, None, 3 1152 conv2d_182[0][0] \n",
2571 "__________________________________________________________________________________________________\n",
2572 "batch_normalization_183 (BatchN (None, None, None, 3 1152 conv2d_183[0][0] \n",
2573 "__________________________________________________________________________________________________\n",
2574 "batch_normalization_186 (BatchN (None, None, None, 3 1152 conv2d_186[0][0] \n",
2575 "__________________________________________________________________________________________________\n",
2576 "batch_normalization_187 (BatchN (None, None, None, 3 1152 conv2d_187[0][0] \n",
2577 "__________________________________________________________________________________________________\n",
2578 "conv2d_188 (Conv2D) (None, None, None, 1 393216 average_pooling2d_18[0][0] \n",
2579 "__________________________________________________________________________________________________\n",
2580 "batch_normalization_180 (BatchN (None, None, None, 3 960 conv2d_180[0][0] \n",
2581 "__________________________________________________________________________________________________\n",
2582 "activation_280 (Activation) (None, None, None, 3 0 batch_normalization_182[0][0] \n",
2583 "__________________________________________________________________________________________________\n",
2584 "activation_281 (Activation) (None, None, None, 3 0 batch_normalization_183[0][0] \n",
2585 "__________________________________________________________________________________________________\n",
2586 "activation_284 (Activation) (None, None, None, 3 0 batch_normalization_186[0][0] \n",
2587 "__________________________________________________________________________________________________\n",
2588 "activation_285 (Activation) (None, None, None, 3 0 batch_normalization_187[0][0] \n",
2589 "__________________________________________________________________________________________________\n",
2590 "batch_normalization_188 (BatchN (None, None, None, 1 576 conv2d_188[0][0] \n",
2591 "__________________________________________________________________________________________________\n",
2592 "activation_278 (Activation) (None, None, None, 3 0 batch_normalization_180[0][0] \n",
2593 "__________________________________________________________________________________________________\n",
2594 "mixed9_1 (Concatenate) (None, None, None, 7 0 activation_280[0][0] \n",
2595 " activation_281[0][0] \n",
2596 "__________________________________________________________________________________________________\n",
2597 "concatenate_4 (Concatenate) (None, None, None, 7 0 activation_284[0][0] \n",
2598 " activation_285[0][0] \n",
2599 "__________________________________________________________________________________________________\n",
2600 "activation_286 (Activation) (None, None, None, 1 0 batch_normalization_188[0][0] \n",
2601 "__________________________________________________________________________________________________\n",
2602 "mixed10 (Concatenate) (None, None, None, 2 0 activation_278[0][0] \n",
2603 " mixed9_1[0][0] \n",
2604 " concatenate_4[0][0] \n",
2605 " activation_286[0][0] \n",
2606 "==================================================================================================\n",
2607 "Total params: 21,802,784\n",
2608 "Trainable params: 21,768,352\n",
2609 "Non-trainable params: 34,432\n",
2610 "__________________________________________________________________________________________________\n"
2611 ]
2612 }
2613 ],
2614 "source": [
2615 "inception = InceptionV3(include_top=False)\n",
2616 "inception.summary()"
2617 ]
2618 }
2619 ],
2620 "metadata": {
2621 "kernelspec": {
2622 "display_name": "Python 3",
2623 "language": "python",
2624 "name": "python3"
2625 },
2626 "language_info": {
2627 "codemirror_mode": {
2628 "name": "ipython",
2629 "version": 3
2630 },
2631 "file_extension": ".py",
2632 "mimetype": "text/x-python",
2633 "name": "python",
2634 "nbconvert_exporter": "python",
2635 "pygments_lexer": "ipython3",
2636 "version": "3.6.8"
2637 },
2638 "toc": {
2639 "base_numbering": 1,
2640 "nav_menu": {},
2641 "number_sections": true,
2642 "sideBar": true,
2643 "skip_h1_title": true,
2644 "title_cell": "Table of Contents",
2645 "title_sidebar": "Contents",
2646 "toc_cell": false,
2647 "toc_position": {},
2648 "toc_section_display": true,
2649 "toc_window_display": false
2650 }
2651 },
2652 "nbformat": 4,
2653 "nbformat_minor": 2
2654 }