Geometry aware data augmentation for monocular 3D object detection. This paper focuses on monocular 3D object detection, one of the essential modules in autonomous driving systems. A key challenge is that the depth recovery problem is ill posed in monocular data. In this work, we first conduct a thorough analysis to reveal how existing methods fail to robustly estimate depth when different geometry shifts occur. In particular, through a series of image based and instance based manipulations for current detectors, we illustrate existing detectors are vulnerable in capturing the consistent relationships between depth and both object apparent sizes and positions. To alleviate this issue and improve the robustness of detectors, we convert the aforementioned manipulations into four corresponding 3D aware data augmentation techniques. At the image level, we randomly manipulate the camera system, including its focal length, receptive field and location, to generate new training images with geometric shifts. At the instance level, we crop the foreground objects and randomly paste them to other scenes to generate new training instances. All the proposed augmentation techniques share the virtue that geometry relationships in objects are preserved while their geometry is manipulated. In light of the proposed data augmentation methods, not only the instability of depth recovery is effectively alleviated, but also the final 3D detection performance is significantly improved. This leads to superior improvements on the KITTI and nuScenes monocular 3D detection benchmarks with state of the art results.


Zero Shot Reinforcement Learning on Graphs for Autonomous Exploration Under Uncertainty. This paper studies the problem of autonomous exploration under localization uncertainty for a mobile robot with 3D range sensing. We present a framework for self learning a high performance exploration policy in a single simulation environment, and transferring it to other environments, which may be physical or virtual. Recent work in transfer learning achieves encouraging performance by domain adaptation and domain randomization to expose an agent to scenarios that fill the inherent gaps in sim2sim and sim2real approaches. However, it is inefficient to train an agent in environments with randomized conditions to learn the important features of its current state. An agent can use domain knowledge provided by human experts to learn efficiently. We propose a novel approach that uses graph neural networks in conjunction with deep reinforcement learning, enabling decision making over graphs containing relevant exploration information provided by human experts to predict a robot's optimal sensing action in belief space. The policy, which is trained only in a single simulation environment, offers a real time, scalable, and transferable decision making strategy, resulting in zero shot transfer to other simulation environments and even real world environments.


MFAGAN A Compression Framework for Memory Efficient On Device Super Resolution GAN. Generative adversarial networks (GANs) have promoted remarkable advances in single image super resolution (SR) by recovering photo realistic images. However, high memory consumption of GAN based SR (usually generators) causes performance degradation and more energy consumption, hindering the deployment of GAN based SR into resource constricted mobile devices. In this paper, we propose a novel compression framework textbf M ulti scale textbf F eature textbf A ggregation Net based textbf GAN (MFAGAN) for reducing the memory access cost of the generator. First, to overcome the memory explosion of dense connections, we utilize a memory efficient multi scale feature aggregation net as the generator. Second, for faster and more stable training, our method introduces the PatchGAN discriminator. Third, to balance the student discriminator and the compressed generator, we distill both the generator and the discriminator. Finally, we perform a hardware aware neural architecture search (NAS) to find a specialized SubGenerator for the target mobile phone. Benefiting from these improvements, the proposed MFAGAN achieves up to textbf 8.3 times memory saving and textbf 42.9 times computation reduction, with only minor visual quality degradation, compared with ESRGAN. Empirical studies also show sim textbf 70 milliseconds latency on Qualcomm Snapdragon 865 chipset.


An Automated Multiple Choice Question Generation Using Natural Language Processing Techniques. Automatic multiple choice question generation (MCQG) is a useful yet challenging task in Natural Language Processing (NLP). It is the task of automatic generation of correct and relevant questions from textual data. Despite its usefulness, manually creating sizeable, meaningful and relevant questions is a time consuming and challenging task for teachers. In this paper, we present an NLP based system for automatic MCQG for Computer Based Testing Examination (CBTE).We used NLP technique to extract keywords that are important words in a given lesson material. To validate that the system is not perverse, five lesson materials were used to check the effectiveness and efficiency of the system. The manually extracted keywords by the teacher were compared to the auto generated keywords and the result shows that the system was capable of extracting keywords from lesson materials in setting examinable questions. This outcome is presented in a user friendly interface for easy accessibility.


Airfoil GAN Encoding and Synthesizing Airfoils forAerodynamic aware Shape Optimization. The current design of aerodynamic shapes, like airfoils, involves computationally intensive simulations to explore the possible design space. Usually, such design relies on the prior definition of design parameters and places restrictions on synthesizing novel shapes. In this work, we propose a data driven shape encoding and generating method, which automatically learns representations from existing airfoils and uses the learned representations to generate new airfoils. The representations are then used in the optimization of synthesized airfoil shapes based on their aerodynamic performance. Our model is built upon VAEGAN, a neural network that combines Variational Autoencoder with Generative Adversarial Network and is trained by the gradient based technique. Our model can (1) encode the existing airfoil into a latent vector and reconstruct the airfoil from that, (2) generate novel airfoils by randomly sampling the latent vectors and mapping the vectors to the airfoil coordinate domain, and (3) synthesize airfoils with desired aerodynamic properties by optimizing learned features via a genetic algorithm. Our experiments show that the learned features encode shape information thoroughly and comprehensively without predefined design parameters. By interpolating extrapolating feature vectors or sampling from Gaussian noises, the model can automatically synthesize novel airfoil shapes, some of which possess competitive or even better aerodynamic properties comparing with training airfoils. By optimizing shape on learned features via a genetic algorithm, synthesized airfoils can evolve to have specific aerodynamic properties, which can guide designing aerodynamic products effectively and efficiently.


Implementing Parallel Quick Sort Algorithm on OTIS Hyper Hexa Cell (OHHC) Interconnection Network. This work explores the characteristics of implementing parallel Quick Sort algorithm over the OTIS Hyper Hexa Cell interconnection network OHHC. OHHC interconnection architecture offers efficient processor connectivity by utilizing both electronic and optical based connections. The work presented includes analytical evaluation of the algorithm as well as simulated evaluation over a multi threading environment. Different experiments were performed using different OHHC dimensions, different integer array types and different array sizes. The evaluation and simulation demonstrated encouraging results that proposes the OHHC connectivity networks as a promising architecture.


Yet another eigenvalue algorithm for solving polynomial systems. In latest years, several advancements have been made in symbolic numerical eigenvalue techniques for solving polynomial systems. In this article, we add to this list. We design an algorithm which solves systems with isolated solutions reliably and efficiently. In overdetermined cases, it reduces the task to an eigenvalue problem in a simpler and considerably faster way than in previous methods, and it can outperform the homotopy continuation approach. We provide many examples and an implementation in the proof of concept Julia package EigenvalueSolver.jl.


Comaximal Factorization Lattices. Brewer and Heinzer studied the (integral) domains D having the property that each proper ideal A of D has a comaximal ideal factorization with some additional property. They proved that for a domain D, the following are equivalent (1) Each proper ideal A of D has a comaximal factorization where the factors have prime radical (resp. are primary, resp. are prime powers). (2) The prime spectrum of D is a tree under inclusion and each ideal of D has only finitely many minimal primes (resp. D is one dimensional and each ideal of D has only finitely many minimal primes, resp. D is a Dedekind domain). The aim of this paper is to show that most of the results can be obtained in the setup of multiplicative lattices.


Pattern Complexity of Aperiodic Substitutive Subshifts. This paper aims to better understand the link better understand the links between aperiodicity in subshifts and pattern complexity. Our main contribution deals with substitutive subshifts, an equivalent to substitutive tilings in the context of symbolic dynamics. For a class of substitutive subshifts, we prove a quadratic lower bound on their pattern complexity. Together with an already known upper bound, this shows that this class of substitutive subshifts has a pattern complexity in Theta(n 2) . We also prove that the recent bound of Kari and Moutot, showing that any aperiodic subshift has pattern complexity at least mn 1 , is optimal for fixed m and n .


Zero touch Continuous Network Slicing Control via Scalable Actor Critic Learning. Artificial intelligence (AI) driven zero touch network slicing is envisaged as a promising cutting edge technology to harness the full potential of heterogeneous 5G and beyond 5G (B5G) communication systems and enable the automation of demand aware resource management and orchestration (MANO). In this paper, we tackle the issue of B5G radio access network (RAN) joint slice admission control and resource allocation according to proposed slice enabling cell free massive multiple input multiple output (mMIMO) setup by invoking a continuous deep reinforcement learning (DRL) method. We present a novel Actor Critic based network slicing approach called, prioritized twin delayed distributional deep deterministic policy gradient (D TD3) . The paper defines and corroborates via extensive experimental results a zero touch network slicing scheme with a multi objective approach where the central server learns continuously to accumulate the knowledge learned in the past to solve future problems and re configure computing resources autonomously while minimizing latency, energy consumption, and virtual network function (VNF) instantiation cost for each slice. Moreover, we pursue a state action return distribution learning approach with the proposed replay policy and reward penalty mechanisms. Finally, we present numerical results to showcase the gain of the adopted multi objective strategy and verify the performance in terms of achieved slice admission rate, latency, energy, CPU utilization, and time efficiency.


A Deep Learning Approach for Masking Fetal Gender in Ultrasound Images. Ultrasound (US) imaging is highly effective with regards to both cost and versatility in real time diagnosis however, determination of fetal gender by US scan in the early stages of pregnancy is also a cause of sex selective abortion. This work proposes a deep learning object detection approach to accurately mask fetal gender in US images in order to increase the accessibility of the technology. We demonstrate how the YOLOv5L architecture exhibits superior performance relative to other object detection models on this task. Our model achieves 45.8 AP 0.5 0.95 , 92 F1 score and 0.006 False Positive Per Image rate on our test set. Furthermore, we introduce a bounding box delay rule based on frame to frame structural similarity to reduce the false negative rate by 85 , further improving masking reliability.


Implementation and performance analysis of efficient grid free integral wall models in unstructured grid LES solvers. Two zonal wall models based on integral form of the boundary layer differential equations, albeit with algebraic complexity, have been implemented in an unstructured grid cell centered finite volume LES solver. The first model is a novel implementation of the ODE equilibrium wall model, where the velocity profile is expressed in the integral form using the constant shear stress layer assumption and the integral is evaluated using a spectral quadrature method, resulting in a local and algebraic (grid free) formulation. The second model, which closely follows the integral wall model of Yang et al. (Phys. Fluids 27, 025112 (2015)), is based on the vertically integrated thin boundary layer PDE along with a prescribed composite velocity profile in the wall modeled region. Several numerical challenges unique to the implementation of these integral models in unstructured mesh environments, such as the exchange of wall quantities between wall faces and LES cells, and the computation of surface gradients, are identified and possible remedies are proposed. The performance of the wall models is assessed both in a priori and a posteriori settings against the traditional finite volume based ODE equilibrium wall model, showing a comparable computational cost for the integral wall model, and superior performance for the spectral implementation over the finite volume based approach. Load imbalance among the processors in parallel simulations seems to severely degrade the parallel efficiency of finite volume based ODE wall model, whereas the spectral implementation is remarkably agnostic to these effects.


DQN Based Multi User Power Allocation for Hybrid RF VLC Networks. In this paper, a Deep Q Network (DQN) based multi agent multi user power allocation algorithm is proposed for hybrid networks composed of radio frequency (RF) and visible light communication (VLC) access points (APs). The users are capable of multihoming, which can bridge RF and VLC links for accommodating their bandwidth requirements. By leveraging a non cooperative multi agent DQN algorithm, where each AP is an agent, an online power allocation strategy is developed to optimize the transmit power for providing users' required data rate. Our simulation results demonstrate that DQN's median convergence time training is 90 shorter than the Q Learning (QL) based algorithm. The DQN based algorithm converges to the desired user rate in half duration on average while converging with the rate of 96.1 compared to the QL based algorithm's convergence rate of 72.3 Additionally, thanks to its continuous state space definition, the DQN based power allocation algorithm provides average user data rates closer to the target rates than the QL based algorithm when it converges.


The Fourth Dimension From its spatial nature in Euclidean geometry to a time like component of non Euclidean manifolds. In this article, the evolution of the ideas about the fourth spatial dimension is presented, starting from those which come out within classical Euclidean geometry and going through those arose in the framework of non Euclidean geometries, like those of Riemann and Minkowski. Particular attention is given to the moment when real time is effectively considered as a fourth dimension, as introduced by Einstein.


A Study of Social and Behavioral Determinants of Health in Lung Cancer Patients Using Transformers based Natural Language Processing Models. Social and behavioral determinants of health (SBDoH) have important roles in shaping people's health. In clinical research studies, especially comparative effectiveness studies, failure to adjust for SBDoH factors will potentially cause confounding issues and misclassification errors in either statistical analyses and machine learning based models. However, there are limited studies to examine SBDoH factors in clinical outcomes due to the lack of structured SBDoH information in current electronic health record (EHR) systems, while much of the SBDoH information is documented in clinical narratives. Natural language processing (NLP) is thus the key technology to extract such information from unstructured clinical text. However, there is not a mature clinical NLP system focusing on SBDoH. In this study, we examined two state of the art transformer based NLP models, including BERT and RoBERTa, to extract SBDoH concepts from clinical narratives, applied the best performing model to extract SBDoH concepts on a lung cancer screening patient cohort, and examined the difference of SBDoH information between NLP extracted results and structured EHRs (SBDoH information captured in standard vocabularies such as the International Classification of Diseases codes). The experimental results show that the BERT based NLP model achieved the best strict lenient F1 score of 0.8791 and 0.8999, respectively. The comparison between NLP extracted SBDoH information and structured EHRs in the lung cancer patient cohort of 864 patients with 161,933 various types of clinical notes showed that much more detailed information about smoking, education, and employment were only captured in clinical narratives and that it is necessary to use both clinical narratives and structured EHRs to construct a more complete picture of patients' SBDoH factors.


And or trade off in artificial neurons impact on adversarial robustness. Since its discovery in 2013, the phenomenon of adversarial examples has attracted a growing amount of attention from the machine learning community. A deeper understanding of the problem could lead to a better comprehension of how information is processed and encoded in neural networks and, more in general, could help to solve the issue of interpretability in machine learning. Our idea to increase adversarial resilience starts with the observation that artificial neurons can be divided in two broad categories AND like neurons and OR like neurons. Intuitively, the former are characterised by a relatively low number of combinations of input values which trigger neuron activation, while for the latter the opposite is true. Our hypothesis is that the presence in a network of a sufficiently high number of OR like neurons could lead to classification "brittleness" and increase the network's susceptibility to adversarial attacks. After constructing an operational definition of a neuron AND like behaviour, we proceed to introduce several measures to increase the proportion of AND like neurons in the network L1 norm weight normalisation application of an input filter comparison between the neuron output's distribution obtained when the network is fed with the actual data set and the distribution obtained when the network is fed with a randomised version of the former called "scrambled data set". Tests performed on the MNIST data set hint that the proposed measures could represent an interesting direction to explore.


cs.LG math.AP physics.flu-dyn physics.geo-ph

Physics Informed Machine Learning Method for Large Scale Data Assimilation Problems. We develop a physics informed machine learning approach for large scale data assimilation and parameter estimation and apply it for estimating transmissivity and hydraulic head in the two dimensional steady state subsurface flow model of the Hanford Site given synthetic measurements of said variables. In our approach, we extend the physics informed conditional Karhunen Lo ' e ve expansion (PICKLE) method for modeling subsurface flow with unknown flux (Neumann) and varying head (Dirichlet) boundary conditions. We demonstrate that the PICKLE method is comparable in accuracy with the standard maximum a posteriori (MAP) method, but is significantly faster than MAP for large scale problems. Both methods use a mesh to discretize the computational domain. In MAP, the parameters and states are discretized on the mesh therefore, the size of the MAP parameter estimation problem directly depends on the mesh size. In PICKLE, the mesh is used to evaluate the residuals of the governing equation, while the parameters and states are approximated by the truncated conditional Karhunen Lo ' e ve expansions with the number of parameters controlled by the smoothness of the parameter and state fields, and not by the mesh size. For a considered example, we demonstrate that the computational cost of PICKLE increases near linearly (as N FV 1.15 ) with the number of grid points N FV , while that of MAP increases much faster as N FV 3.28 . We demonstrated that once trained for one set of Dirichlet boundary conditions (i.e., one river stage), the PICKLE method provides accurate estimates of the hydraulic head for any value of the Dirichlet boundary conditions (i.e., for any river stage).


Two dimensional array for operating an oscillator in Euclidean space mathbb R 3 , as a power multiplier. In the present study an oscillator system formed by a seesaw connected to a simple pendulum coupled to a mobile platform with a certain slope, is analyzed. The observed properties of the system when faced with a possible displacement of the mobile are affected in terms of energy loss, which can be reflected in the angle, the variation of apparent weight and the height. The possible variations which can be introduced modify these parameters, so that the system tries to compensate them in order to preserve its symmetry. The working of this system can be described by means of a transformation matrix where the nature of the movement is represented. Such tool enables us to observe the variations that the system may experience as rotation and translation functions. Therefore, the matrix offers a clear visualization of the values expressed and thus of the need to either provide or extract energy to or from the system.


Convex co compact groups with one dimensional boundary faces. In this paper we consider convex co compact subgroups of the projective linear group. We prove that such a group is relatively hyperbolic with respect to a collection of virtually Abelian subgroups of rank two if and only if each open face in the ideal boundary has dimension at most one. We also introduce the "coarse Hilbert dimension" of a subset of a convex set and use it to characterize when a naive convex co compact subgroup is word hyperbolic or relatively hyperbolic with respect to a collection of virtually Abelian subgroups of rank two.


TCL Transformer based Dynamic Graph Modelling via Contrastive Learning. Dynamic graph modeling has recently attracted much attention due to its extensive applications in many real world scenarios, such as recommendation systems, financial transactions, and social networks. Although many works have been proposed for dynamic graph modeling in recent years, effective and scalable models are yet to be developed. In this paper, we propose a novel graph neural network approach, called TCL, which deals with the dynamically evolving graph in a continuous time fashion and enables effective dynamic node representation learning that captures both the temporal and topology information. Technically, our model contains three novel aspects. First, we generalize the vanilla Transformer to temporal graph learning scenarios and design a graph topology aware transformer. Secondly, on top of the proposed graph transformer, we introduce a two stream encoder that separately extracts representations from temporal neighborhoods associated with the two interaction nodes and then utilizes a co attentional transformer to model inter dependencies at a semantic level. Lastly, we are inspired by the recently developed contrastive learning and propose to optimize our model by maximizing mutual information (MI) between the predictive representations of two future interaction nodes. Benefiting from this, our dynamic representations can preserve high level (or global) semantics about interactions and thus is robust to noisy interactions. To the best of our knowledge, this is the first attempt to apply contrastive learning to representation learning on dynamic graphs. We evaluate our model on four benchmark datasets for interaction prediction and experiment results demonstrate the superiority of our model.


The Generic Isogeny Decomposition of the Prym Variety of a Cyclic Branched Covering. Let f colon S' longrightarrow S be a cyclic branched covering of smooth projective surfaces over mathbb C whose branch locus Delta subset S is a smooth ample divisor. Pick a very ample complete linear system mathcal H on S , such that the polarized surface (S, mathcal H ) is not a scroll nor has rational hyperplane sections. For the general member C in mathcal H consider the mu n equivariant isogeny decomposition of the Prym variety Prym(C' C) of the induced covering f colon C' f 1 (C) longrightarrow C Prym(C' C) sim prod d n, d neq1 mathcal P d (C' C). We show that for the very general member C in mathcal H the isogeny component mathcal P d (C' C) is mu d simple with End mu d ( mathcal P d (C' C)) cong mathbb Z zeta d . In addition, for the non ample case we reformulate the result by considering the identity component of the kernel of the map mathcal P d (C' C) subset Jac(C') longrightarrow Alb(S') .


CamTuner Reinforcement Learning based System for Camera Parameter Tuning to enhance Analytics. Video analytics systems critically rely on video cameras, which capture high quality video frames, to achieve high analytics accuracy. Although modern video cameras often expose tens of configurable parameter settings that can be set by end users, deployment of surveillance cameras today often uses a fixed set of parameter settings because the end users lack the skill or understanding to reconfigure these parameters. In this paper, we first show that in a typical surveillance camera deployment, environmental condition changes can significantly affect the accuracy of analytics units such as person detection, face detection and face recognition, and how such adverse impact can be mitigated by dynamically adjusting camera settings. We then propose CAMTUNER, a framework that can be easily applied to an existing video analytics pipeline (VAP) to enable automatic and dynamic adaptation of complex camera settings to changing environmental conditions, and autonomously optimize the accuracy of analytics units (AUs) in the VAP. CAMTUNER is based on SARSA reinforcement learning (RL) and it incorporates two novel components a light weight analytics quality estimator and a virtual camera. CAMTUNER is implemented in a system with AXIS surveillance cameras and several VAPs (with various AUs) that processed day long customer videos captured at airport entrances. Our evaluations show that CAMTUNER can adapt quickly to changing environments. We compared CAMTUNER with two alternative approaches where either static camera settings were used, or a strawman approach where camera settings were manually changed every hour (based on human perception of quality). We observed that for the face detection and person detection AUs, CAMTUNER is able to achieve up to 13.8 and 9.2 higher accuracy, respectively, compared to the best of the two approaches (average improvement of 8 for both AUs).


Risk Free Bidding in Complement Free Combinatorial Auctions. We study risk free bidding strategies in combinatorial auctions with incomplete information. Specifically, what is the maximum profit that a complement free (subadditive) bidder can guarantee in a multi item combinatorial auction? Suppose there are n bidders and B i is the value that bidder i has for the entire set of items. We study the above problem from the perspective of the first bidder, Bidder 1. In this setting, the worst case profit guarantees arise in a duopsony, that is when n 2 , so this problem then corresponds to playing an auction against a budgeted adversary with budget B 2 . We present worst case guarantees for two simple and widely studied combinatorial auctions, namely, the sequential and simultaneous auctions, for both the first price and second price case. In the general case of distinct items, our main results are for the class of em fractionally subadditive (XOS) bidders, where we show that for both first price and second price sequential auctions Bidder 1 has a strategy that guarantees a profit of at least ( sqrt B 1 sqrt B 2 ) 2 when B 2 leq B 1 , and this bound is tight. More profitable guarantees can be obtained for simultaneous auctions, where in the first price case, Bidder 1 has a strategy that guarantees a profit of at least frac (B 1 B 2) 2 2B 1 , and in the second price case, a bound of B 1 B 2 is achievable. We also consider the special case of sequential auctions with identical items, for which we provide tight guarantees for bidders with subadditive valuations.


Complementary Ensemble Learning. To achieve high performance of a machine learning (ML) task, a deep learning based model must implicitly capture the entire distribution from data. Thus, it requires a huge amount of training samples, and data are expected to fully present the real distribution, especially for high dimensional data, e.g., images, videos. In practice, however, data are usually collected with a diversity of styles, and several of them have insufficient number of representatives. This might lead to uncertainty in models' prediction, and significantly reduce ML task performance. In this paper, we provide a comprehensive study on this problem by looking at model uncertainty. From this, we derive a simple but efficient technique to improve performance of state of the art deep learning models. Specifically, we train auxiliary models which are able to complement state of the art model uncertainty. As a result, by assembling these models, we can significantly improve the ML task performance for types of data mentioned earlier. While slightly improving ML classification accuracy on benchmark datasets (e.g., 0.2 on MNIST), our proposed method significantly improves on limited data (i.e., 1.3 on Eardrum and 3.5 on ChestXray).


Vector valued reproducing kernel Hilbert C modules. The aim of this paper is to present a unified framework in the setting of Hilbert C modules for the scalar and vector valued reproducing kernel Hilbert spaces and C valued reproducing kernel spaces. We investigate conditionally negative definite kernels with values in the C algebra of adjointable operators acting on a Hilbert C module. In addition, we show that there exists a two sided connection between positive definite kernels and reproducing kernel Hilbert C modules. Furthermore, we explore some conditions under which a function is in the reproducing kernel module and present an interpolation theorem. Moreover, we study some basic properties of the so called relative reproducing kernel Hilbert C modules and give a characterization of dual modules. Among other things, we prove that every conditionally negative definite kernel gives us a reproducing kernel Hilbert C module and a certain map. Several examples illustrate our investigation.


TexRel a Green Family of Datasets for Emergent Communications on Relations. We propose a new dataset TexRel as a playground for the study of emergent communications, in particular for relations. By comparison with other relations datasets, TexRel provides rapid training and experimentation, whilst being sufficiently large to avoid overfitting in the context of emergent communications. By comparison with using symbolic inputs, TexRel provides a more realistic alternative whilst remaining efficient and fast to learn. We compare the performance of TexRel with a related relations dataset Shapeworld. We provide baseline performance results on TexRel for sender architectures, receiver architectures and end to end architectures. We examine the effect of multitask learning in the context of shapes, colors and relations on accuracy, topological similarity and clustering precision. We investigate whether increasing the size of the latent meaning space improves metrics of compositionality. We carry out a case study on using TexRel to reproduce the results of an experiment in a recent paper that used symbolic inputs, but using our own non symbolic inputs, from TexRel, instead.


Detecting socially interacting groups using f formation A survey of taxonomy, methods, datasets, applications, challenges, and future research directions. Robots in our daily surroundings are increasing day by day. Their usability and acceptability largely depend on their explicit and implicit interaction capability with fellow human beings. As a result, social behavior is one of the most sought after qualities that a robot can possess. However, there is no specific aspect and or feature that defines socially acceptable behavior and it largely depends on the situation, application, and society. In this article, we investigate one such social behavior for collocated robots. Imagine a group of people is interacting with each other and we want to join the group. We as human beings do it in a socially acceptable manner, i.e., within the group, we do position ourselves in such a way that we can participate in the group activity without disturbing obstructing anybody. To possess such a quality, first, a robot needs to determine the formation of the group and then determine a position for itself, which we humans do implicitly. The theory of f formation can be utilized for this purpose. As the types of formations can be very diverse, detecting the social groups is not a trivial task. In this article, we provide a comprehensive survey of the existing work on social interaction and group detection using f formation for robotics and other applications. We also put forward a novel holistic survey framework combining all the possible concerns and modules relevant to this problem. We define taxonomies based on methods, camera views, datasets, detection capabilities and scale, evaluation approaches, and application areas. We discuss certain open challenges and limitations in current literature along with possible future research directions based on this framework. In particular, we discuss the existing methods techniques and their relative merits and demerits, applications, and provide a set of unsolved but relevant problems in this domain.


Further study on Horozov Iliev's method of estimating the number of limit cycles. In the study of the number of limit cycles of near Hamiltonian systems, the first order Melnikov function plays an important role. This paper aims to establish a development of a known method to estimate the upper bound of the number of zeros of the function.


Strong field ionisation of Argon Electron momentum spectra and nondipole effects. We investigate the influence of relativistic nondipole effects on the photoelectron spectra of argon, particularly in the low kinetic energy region (0 eV 5 eV). In our experiment, we use intense linearly polarised 800 nm laser pulse to ionise Ar from a jet and we record photoelectron energy and momentum distributions using a reaction microscope (REMI). Our measurements show that nondipole effect can cause an energy dependent asymmetry along the laser propagation direction in the photoelectron energy and momentum spectra. Model simulation based on time dependent Dirac equation (TDDE) can reproduce our measurement results. The electron trajectory analysis based on classical model reveals that the photoelectron which obtains negative momentum shift along laser propagation direction is caused by the interplay between the Lorenz force induced radiation pressure during its free propagation in continuum and re scattering by Coulomb potential of the parent ion when it is driven back by the laser field.


A Relational learning Perspective to Multi label Chest X ray Classification. Multi label classification of chest X ray images is frequently performed using discriminative approaches, i.e. learning to map an image directly to its binary labels. Such approaches make it challenging to incorporate auxiliary information such as annotation uncertainty or a dependency among the labels. Building towards this, we propose a novel knowledge graph reformulation of multi label classification, which not only readily increases predictive performance of an encoder but also serves as a general framework for introducing new domain knowledge. Specifically, we construct a multi modal knowledge graph out of the chest X ray images and its labels and pose multi label classification as a link prediction problem. Incorporating auxiliary information can then simply be achieved by adding additional nodes and relations among them. When tested on a publicly available radiograph dataset (CheXpert), our relational reformulation using a naive knowledge graph outperforms the state of art by achieving an area under ROC curve of 83.5 , an improvement of "sim 1" over a purely discriminative approach.


Automatic Graph Partitioning for Very Large scale Deep Learning. This work proposes RaNNC (Rapid Neural Network Connector) as middleware for automatic hybrid parallelism. In recent deep learning research, as exemplified by T5 and GPT 3, the size of neural network models continues to grow. Since such models do not fit into the memory of accelerator devices, they need to be partitioned by model parallelism techniques. Moreover, to accelerate training for huge training data, we need a combination of model and data parallelisms, i.e., hybrid parallelism. Given a model description for PyTorch without any specification for model parallelism, RaNNC automatically partitions the model into a set of subcomponents so that (1) each subcomponent fits a device memory and (2) a high training throughput for pipeline parallelism is achieved by balancing the computation times of the subcomponents. In our experiments, we compared RaNNC with two popular frameworks, Megatron LM (hybrid parallelism) and GPipe (originally proposed for model parallelism, but a version allowing hybrid parallelism also exists), for training models with increasingly greater numbers of parameters. In the pre training of enlarged BERT models, RaNNC successfully trained models five times larger than those Megatron LM could, and RaNNC's training throughputs were comparable to Megatron LM's when pre training the same models. RaNNC also achieved better training throughputs than GPipe on both the enlarged BERT model pre training (GPipe with hybrid parallelism) and the enlarged ResNet models (GPipe with model parallelism) in all of the settings we tried. These results are remarkable, since RaNNC automatically partitions models without any modification to their descriptions Megatron LM and GPipe require users to manually rewrite the models' descriptions.


Extremal points of total generalized variation balls in 1D characterization and applications. The total generalized variation (TGV) is a popular regularizer in inverse problems and imaging combining discontinuous solutions and higher order smoothing. In particular, empirical observations suggest that its order two version strongly favors piecewise affine functions. In the present manuscript, we formalize this statement for the one dimensional TGV functional by characterizing the extremal points of its sublevel sets with respect to a suitable quotient space topology. These results imply that 1D TGV regularized linear inverse problems with finite dimensional observations admit piecewise affine minimizers. As further applications of this characterization we include precise first order necessary optimality conditions without requiring convexity of the fidelity term, and a simple solution algorithm for TGV regularized minimization problems.


Compact Java Monitors. For scope and context, the idea we'll describe below, Compact Java Monitors, is intended as a potential replacement implementation for the "synchronized" construct in the HotSpot JVM. The readers is assumed to be familiar with current HotSpot implementation.


Inferring the Reader Guiding Automated Story Generation with Commonsense Reasoning. Transformer based language model approaches to automated story generation currently provide state of the art results. However, they still suffer from plot incoherence when generating narratives over time, and critically lack basic commonsense reasoning. Furthermore, existing methods generally focus only on single character stories, or fail to track characters at all. To improve the coherence of generated narratives and to expand the scope of character centric narrative generation, we introduce Commonsense inference Augmented neural StoryTelling (CAST), a framework for introducing commonsense reasoning into the generation process while modeling the interaction between multiple characters. We find that our CAST method produces significantly more coherent and on topic two character stories, outperforming baselines in dimensions including plot plausibility and staying on topic. We also show how the CAST method can be used to further train language models that generate more coherent stories and reduce computation cost.


An Enhanced Prohibited Items Recognition Model. We proposed a new modeling method to promote the performance of prohibited items recognition via X ray image. We analyzed the characteristics of prohibited items and X ray images. We found the fact that the scales of some items are too small to be recognized which encumber the model performance. Then we adopted a set of data augmentation and modified the model to adapt the field of prohibited items recognition. The Convolutional Block Attention Module(CBAM) and rescoring mechanism has been assembled into the model. By the modification, our model achieved a mAP of 89.9 on SIXray10, mAP of 74.8 .


Predicting Nanorobot Shapes via Generative Models. The field of DNA nanotechnology has made it possible to assemble, with high yields, different structures that have actionable properties. For example, researchers have created components that can be actuated. An exciting next step is to combine these components into multifunctional nanorobots that could, potentially, perform complex tasks like swimming to a target location in the human body, detect an adverse reaction and then release a drug load to stop it. However, as we start to assemble more complex nanorobots, the yield of the desired nanorobot begins to decrease as the number of possible component combinations increases. Therefore, the ultimate goal of this work is to develop a predictive model to maximize yield. However, training predictive models typically requires a large dataset. For the nanorobots we are interested in assembling, this will be difficult to collect. This is because high fidelity data, which allows us to characterize the shape and size of individual structures, is very time consuming to collect, whereas low fidelity data is readily available but only captures bulk statistics for different processes. Therefore, this work combines low and high fidelity data to train a generative model using a two step process. We first use a relatively small, high fidelity dataset to train a generative model. At run time, the model takes low fidelity data and uses it to approximate the high fidelity content. We do this by biasing the model towards samples with specific properties as measured by low fidelity data. In this work we bias our distribution towards a desired node degree of a graphical model that we take as a surrogate representation of the nanorobots that this work will ultimately focus on. We have not yet accumulated a high fidelity dataset of nanorobots, so we leverage the MolGAN architecture 1 and the QM9 small molecule dataset 2 3 to demonstrate our approach.


Exponential Ergodicity for Time Periodic McKean Vlasov SDEs. As extensions to the corresponding results derived for time homogeneous McKean Vlasov SDEs, the exponential ergodicity is proved for time periodic distribution dependent SDEs in three different situations 1) in the quadratic Wasserstein distance and relative entropy for the dissipative case 2) in the Wasserstein distance induced by a cost function for the partially dissipative case and 3) in the weighted Wasserstein distance induced by a cost function and a Lyapunov function for the fully non dissipative case. The main results are illustrated by time inhomogeneous granular media equations, and are extended to reflecting McKean Vlasov SDEs in a convex domain.


SocialBERT Transformers for Online SocialNetwork Language Modelling. The ubiquity of the contemporary language understanding tasks gives relevance to the development of generalized, yet highly efficient models that utilize all knowledge, provided by the data source. In this work, we present SocialBERT the first model that uses knowledge about the author's position in the network during text analysis. We investigate possible models for learning social network information and successfully inject it into the baseline BERT model. The evaluation shows that embedding this information maintains a good generalization, with an increase in the quality of the probabilistic model for the given author up to 7.5 . The proposed model has been trained on the majority of groups for the chosen social network, and still able to work with previously unknown groups. The obtained model, as well as the code of our experiments, is available for download and use in applied tasks.


Asymmetric Si slot Coupler with Nonreciprocal Response Based on Graphene Saturable Absorption. We present the study of a proof of concept integrated device that can be used as a nonlinear broadband isolator. The device is based on the asymmetric loading of a highly confining silicon slot photonic coupler with graphene layers, whose ultrafast and low threshold saturable absorption can be exploited for nonreciprocal transmission between the cross ports of the coupler. The structure is essentially a non Hermitian system, whose exceptional points are briefly discussed. The nonlinear device is modeled with a coupled Schrodinger equation system whose validity is checked by full vector finite element based beam propagation method simulations in CW. The numerically computed performance reveals a nonreciprocal intensity range (NRIR) in the vicinity of 100 mW peak power with a bandwidth spanning tens of nanometers, from CW down to ps long pulses. Finally, the combination of saturable absorption and self phase modulation (Kerr effect) in graphene is studied, indicating the existence of two NRIR with opposite directionality.


DeepPoison Feature Transfer Based Stealthy Poisoning Attack. Deep neural networks are susceptible to poisoning attacks by purposely polluted training data with specific triggers. As existing episodes mainly focused on attack success rate with patch based samples, defense algorithms can easily detect these poisoning samples. We propose DeepPoison, a novel adversarial network of one generator and two discriminators, to address this problem. Specifically, the generator automatically extracts the target class' hidden features and embeds them into benign training samples. One discriminator controls the ratio of the poisoning perturbation. The other discriminator works as the target model to testify the poisoning effects. The novelty of DeepPoison lies in that the generated poisoned training samples are indistinguishable from the benign ones by both defensive methods and manual visual inspection, and even benign test samples can achieve the attack. Extensive experiments have shown that DeepPoison can achieve a state of the art attack success rate, as high as 91.74 , with only 7 poisoned samples on publicly available datasets LFW and CASIA. Furthermore, we have experimented with high performance defense algorithms such as autodecoder defense and DBSCAN cluster detection and showed the resilience of DeepPoison.


Magnetic properties of M 4 coordination clusters with different magnetic cores (M Co, Mn). We present a joint experimental and theoretical characterization of the magnetic properties of coordination clusters with an antiferromagnetic core of four magnetic ions. Two different compounds are analyzed, with Co and Mn ions in the core. While both molecules are antiferromagnetic, they display different sensitivities to external magnetic field, according to the different strength of the intra molecular magnetic coupling. In particular, the dependence of the magnetization versus field of the two molecules switches with temperatures at low temperature the magnetization is smaller in Mn 4 , while the opposite happens at high temperature. Through a detailed analysis of the electronic and magnetic properties of the two compounds we identify a stronger magnetic interaction between the magnetic ions in Mn 4 with respect to Co 4 . Moreover Co 4 displays not negligible spin orbit related effects that could affect the spin lifetime in future antiferromagnetic spintronic applications. We highlight the necessity to account for these spin orbit effects for a reliable description of these compounds.


Equivalence of Models of Cake Cutting Protocols. The cake cutting problem involves dividing a heterogeneous, divisible resource fairly between n agents. Br a nzei et al. 6 introduced em generalised cut and choose (GCC) protocols, a formal model for representing cake cutting protocols as trees with "cut" and "choose" nodes corresponding to the agents' actions, and if else statements. In this paper, we identify an alternative and simpler extensive form game model for cake cutting protocols, that we call em branch choice (BC) protocols. We show that the class of protocols we can represent using this model is invariant under certain modifications to its definition. We further prove that any such protocol can be converted to a restricted form in which the agents first cut the cake and then get to choose between various branches leading to different allocations. Finally, we show that this model has the same expressive power as GCC protocols, i.e. they represent the same class of protocols up to a notion of equivalence involving the bounds on envy that each agent can guarantee for themselves. For this purpose, we introduce a new notion of envy equivalence of protocols.


Simultaneous Joint Lower and Upper record values Probability Laws for Absolutely Continuous or Discrete Data. This paper investigates the probability density function ( pdf ) of the (2n 1) vector (n geq 1) of both lower and upper record values for a sequence of independent random variables with common pdf f defined on the same probability space, provided that the lower and upper record times are finite up to n . A lot is known about the lower or the upper record values when they are studied separately. When put together, the challenges are a far bigger complicated. The rare results in the literature still present important flaws. This paper begins a new and complete investigation with a few number of records 2 and 3. Lessons from these simple cases will allow addressing the general formulation of simultaneous joint lower upper records.


X METRA ADA Cross lingual Meta Transfer Learning Adaptation to Natural Language Understanding and Question Answering. Multilingual models, such as M BERT and XLM R, have gained increasing popularity, due to their zero shot cross lingual transfer learning capabilities. However, their generalization ability is still inconsistent for typologically diverse languages and across different benchmarks. Recently, meta learning has garnered attention as a promising technique for enhancing transfer learning under low resource scenarios particularly for cross lingual transfer in Natural Language Understanding (NLU). In this work, we propose X METRA ADA, a cross lingual MEta TRAnsfer learning ADAptation approach for NLU. Our approach adapts MAML, an optimization based meta learning approach, to learn to adapt to new languages. We extensively evaluate our framework on two challenging cross lingual NLU tasks multilingual task oriented dialog and typologically diverse question answering. We show that our approach outperforms naive fine tuning, reaching competitive performance on both tasks for most languages. Our analysis reveals that X METRA ADA can leverage limited data for faster adaptation.


BLT Bidirectional Layout Transformer for Controllable Layout Generation. Creating visual layouts is an important step in graphic design. Automatic generation of such layouts is important as we seek scale able and diverse visual designs. Prior works on automatic layout generation focus on unconditional generation, in which the models generate layouts while neglecting user needs for specific problems. To advance conditional layout generation, we introduce BLT, a bidirectional layout transformer. BLT differs from autoregressive decoding as it first generates a draft layout that satisfies the user inputs and then refines the layout iteratively. We verify the proposed model on multiple benchmarks with various fidelity metrics. Our results demonstrate two key advances to the state of the art layout transformer models. First, our model empowers layout transformers to fulfill controllable layout generation. Second, our model slashes the linear inference time in autoregressive decoding into a constant complexity, thereby achieving 4x 10x speedups in generating a layout at inference time.


On a question of Vera T. S 'os about size forcing of graphons. The k sample mathbb G (k,W) from a graphon W 0,1 2 to 0,1 is the random graph on 1, dots,k , where we sample x 1, dots,x k in 0,1 uniformly at random and make each pair i,j subseteq 1, dots,k an edge with probability W(x i,x j) , with all these choices being mutually independent. Let the random variable X k(W) be the number of edges in mathbb G (k,W) . Vera T. S 'os asked in 2012 whether two graphons U,W are necessarily weakly isomorphic if the random variables X k(U) and X k(W) have the same distribution for every integer k ge 2 . This question when one of the graphons W is a constant function was answered positively by Endre Cs 'oka and independently by Jacob Fox, Tomasz L uczak and Vera T. S 'os. Here we investigate the question when W is a 2 step graphon and prove that the answer is positive for a 3 dimensional family of such graphons. We also present some related results.


Challenges and Obstacles Towards Deploying Deep Learning Models on Mobile Devices. From computer vision and speech recognition to forecasting trajectories in autonomous vehicles, deep learning approaches are at the forefront of so many domains. Deep learning models are developed using plethora of high level, generic frameworks and libraries. Running those models on the mobile devices require hardware aware optimizations and in most cases converting the models to other formats or using a third party framework. In reality, most of the developed models need to undergo a process of conversion, adaptation, and, in some cases, full retraining to match the requirements and features of the framework that is deploying the model on the target platform. Variety of hardware platforms with heterogeneous computing elements, from wearable devices to high performance GPU clusters are used to run deep learning models. In this paper, we present the existing challenges, obstacles, and practical solutions towards deploying deep learning models on mobile devices.


Degenerating K "ahler Einstein cones, locally symmetric cusps, and the Tian Yau metric. Let X be a complex projective manifold and let D subset X be a smooth divisor. In this article, we are interested in studying limits when k to 0 of K "ahler Einstein metrics omega k with a cone singularity of angle 2 pi k along D . In our first result, we assume that X setminus D is a locally symmetric space and we show that omega k converges to the locally symmetric metric and further give asymptotics of omega k when X setminus D is a ball quotient. Our second result deals with the case when X is Fano and D is anticanonical. We prove a folklore conjecture asserting that a rescaled limit of omega k is the complete, Ricci flat Tian Yau metric on X setminus D . Furthermore, we prove that (X, omega k) converges to an interval in the Gromov Hausdorff sense.


Investigation of the gamma ray shielding performance of the B 2 O 3 Bi 2 O 3 ZnO Li 2 O glasses based on the Monte Carlo approach. The purpose of this article is to investigate the shielding performance of the B 2 O 3 Bi 2 O 3 ZnO Li 2 O glasses as gamma shields. To this end, the attenuation parameters of the gamma ray for B 2 O 3 Bi 2 O 3 ZnO Li 2 O glasses were calculated from the results of the simulation performed by MCNPX computer code. To validate the simulation, the calculated values of mass attenuation coefficients in the energy range of 200 keV to 1500 keV were compared with the XCOM data base. The relative deviation between the results of simulation using the MCNPX and the XCOM database was 2 . Additionally, the mean free path (MFP) and half value layer (HVL) parameters were calculated. The results show that among the examined samples, the B 4 glass sample has the best shielding performance. From the results of the calculation, it can be understood that the addition of compound Li 2 O to compound B 2 O 3 Bi 2 O 3 ZnO Li 2 O has a huge impact on the shielding performance of the examined glass versus gamma rays. In addition, the results show that the existing B 2 O 3 Bi 2 O 3 ZnO Li 2 O glasses will have a promising outlook as gamma rays shield due to the possibility of changing the weight percentage of Li 2 O in them.


Generation of Non Deterministic Synthetic Face Datasets Guided by Identity Priors. Enabling highly secure applications (such as border crossing) with face recognition requires extensive biometric performance tests through large scale data. However, using real face images raises concerns about privacy as the laws do not allow the images to be used for other purposes than originally intended. Using representative and subsets of face data can also lead to unwanted demographic biases and cause an imbalance in datasets. One possible solution to overcome these issues is to replace real face images with synthetically generated samples. While generating synthetic images has benefited from recent advancements in computer vision, generating multiple samples of the same synthetic identity resembling real world variations is still unaddressed, i.e., mated samples. This work proposes a non deterministic method for generating mated face images by exploiting the well structured latent space of StyleGAN. Mated samples are generated by manipulating latent vectors, and more precisely, we exploit Principal Component Analysis (PCA) to define semantically meaningful directions in the latent space and control the similarity between the original and the mated samples using a pre trained face recognition system. We create a new dataset of synthetic face images (SymFace) consisting of 77,034 samples including 25,919 synthetic IDs. Through our analysis using well established face image quality metrics, we demonstrate the differences in the biometric quality of synthetic samples mimicking characteristics of real biometric data. The analysis and results thereof indicate the use of synthetic samples created using the proposed approach as a viable alternative to replacing real biometric data.


Predicting drag on rough surfaces by transfer learning of empirical correlations. Recent developments in neural networks have shown the potential of estimating drag on irregular rough surfaces. Nevertheless, the difficulty of obtaining a large high fidelity dataset to train neural networks is deterring their use in practical applications. In this study, we propose a transfer learning framework to model the drag on irregular rough surfaces even with a limited amount of direct numerical simulations. We show that transfer learning of empirical correlations, reported in the literature, can significantly improve the performance of neural networks for drag prediction. This is because empirical correlations include approximate knowledge' of the drag dependency in high fidelity physics. The approximate knowledge' allows neural networks to learn the surface statistics known to affect drag more efficiently. The developed framework can be applied to applications where acquiring a large dataset is difficult, but empirical correlations have been reported.


Online Bipartite Matching and Adwords. The simplicity of the recently obtained proof of the optimal algorithm for online bipartite matching (OBM), called RANKING cite KVV , naturally raises the possibility of extending this algorithm to the adwords problem, or its special case called SMALL, in which bids are small compared to budgets the latter has been of considerable practical significance in ad auctions cite MSVV . The attractive feature of our approach, in contrast to cite MSVV , was that it would yield a em budget oblivious algorithm , i.e., during its execution, the algorithm would not need to know what fraction of budget each bidder has spent only whether there is budget left over. This would immediately render the algorithm useful for autobidding platforms. Our attempt met several hurdles, which are described in detail in the paper. In particular, a substantial probabilistic development led us to obtain an optimal, online, budget oblivious algorithm for SINGLE VALUED, which is intermediate between OMB and the adwords problem this algorithm is a natural generalization of RANKING. For SMALL, we managed to overcome all but one hurdle, namely failure of a property, called the no surpassing property. Interestingly enough, this property plays a minor role in the proofs of RANKING as well as our algorithm for SINGLE VALUED.


Generalized Alternating Projections on Manifolds and Convex Sets. In this paper we extend the previous convergence results on the generalized alternating projection method, from subspaces arXiv 1703.10547 , to include smooth manifolds. We show that locally it will behave in the same way, with the same rate as predicted in arXiv 1703.10547 . The goal is to get closer to a rate for general convex sets, where convergence, but not rate is known. If a finite identification property can be shown for two convex sets, to locally smooth manifolds, then the rates from this paper also apply to those sets. We present a few examples where this is the case, and also a counter example for when this is not the case.


Numerical simulations of convection heat transfer in porous media using a cascaded lattice Boltzmann method. Convection heat transfer in porous media is a universal phenomenon in nature, and it is also frequently encountered in scientific and engineering fields. An in depth understanding of the fundamental mechanism of convection heat transfer in porous media requires efficient and powerful numerical tools. In this paper, a cascaded lattice Boltzmann (CLB) method for convection heat transfer in porous media at the representative elementary volume (REV) scale is presented. In the CLB method, the flow field is solved by an isothermal CLB model with the D2Q9 lattice based on the generalized non Darcy model, while the temperature field is solved by a temperature based CLB model with the D2Q5 lattice. The key point is to incorporate the influence of the porous media into the CLB method by introducing the porosity and heat capacity ratio into the shift matrices. The effectiveness and practicability of the present method are validated by numerical simulations of several heat transfer problems in porous media at the REV scale. It is shown that the present method for convection heat transfer in porous media is second order accurate in space. Moreover, in comparison with the Bhatnagar Gross Krook lattice Boltzmann method, the present method has sufficient tunable parameters and possesses better numerical stability.


Path Connectedness in Global Bifurcation Theory. A celebrated result in bifurcation theory is that global connected sets of non trivial solutions bifurcate from trivial solutions at non zero eigenvalues of odd algebraic multiplicity of the linearized problem when the operators involved are compact. In this paper a simple example is constructed which satisfies the regularity hypotheses of the global bifurcation theorem, and the eigenvalue has algebraic multiplicity one, yet all the path connected components of the connected sets that bifurcate are singletons. Another example shows that even when the operators are everywhere infinitely differentiable and classical bifurcation occurs locally at a simple eigenvalue, the global continuum may not be path connected away from the bifurcation point. A third example shows that the non trivial solutions which, by variational theory, bifurcate from eigenvalues of any multiplicity when the problem has gradient structure, may not be connected and may contain no paths except singletons.


Optimization Study of Hydraulic Power Take off System for an Ocean Wave Energy Converter. Ocean wave renewable energy is fast becoming a key part of renewable energy industries over the recent decades. By developing wave energy converters as the main converter technology in this process, their power take off (PTO) systems have been investigated. Adjusting PTO parameters is a challenging optimization problem because there is a complex and nonlinear relationship between these parameters and the absorbed power output. In this regard, this study aims to optimize the PTO system parameters of a point absorber wave energy converter in the wave scenario in Perth, on Western Australian coasts. The converter is numerically designed to oscillate against irregular and multi dimensional waves and sensitivity analysis for PTO settings is performed. Then, to find the optimal PTO system parameters which lead to the highest power output, ten optimization algorithms are incorporated to solve the non linear problem, Including Nelder Mead search method, Active set method, Sequential quadratic Programming method (SQP), Multi Verse Optimizer (MVO), and six modified combination of Genetic, Surrogate and fminsearch algorithms. After a feasibility landscape analysis, the optimization outcome is carried out and gives us the best answer in terms of PTO system settings. Finally, the investigation shows that the modified combinations of Genetic, Surrogate, and fminsearch algorithms can outperform the others in the studied wave scenario, as well as the interaction between PTO system variables.


Robust a posteriori error analysis for rotation based formulations of the elasticity poroelasticity coupling. We develop the textit a posteriori error analysis of three mixed finite element formulations for rotation based equations in elasticity, poroelasticity, and interfacial elasticity poroelasticity. The discretisations use H 1 conforming finite elements of degree k 1 for displacement and fluid pressure, and discontinuous piecewise polynomials of degree k for rotation vector, total pressure, and elastic pressure. Residual based estimators are constructed, and upper and lower bounds (up to data oscillations) for all global estimators are rigorously derived. The methods are all robust with respect to the model parameters (in particular, the Lam 'e constants), they are valid in 2D and 3D, and also for arbitrary polynomial degree k geq 0 . The error behaviour predicted by the theoretical analysis is then demonstrated numerically on a set of computational examples including different geometries on which we perform adaptive mesh refinement guided by the textit a posteriori error estimators.


Purcell effect in PT symmetric waveguides. This chapter overviews the principles of the spontaneous emission rate increase, that is the Purcell effect, in relation to the photonic parity time (PT) symmetry. Being focused on the system of coupled PT symmetric optical waveguides, we consider behaviors of the Purcell factor in PT symmetric and broken PT symmetric regimes. Surprisingly, exceptional points in a coupled waveguide do not influence on the Purcell factor.


Information algebras of coherent sets of gambles in general possibility spaces. In this paper, we show that coherent sets of gambles can be embedded into the algebraic structure of information algebra. This leads firstly, to a new perspective of the algebraic and logical structure of desirability and secondly, it connects desirability, hence imprecise probabilities, to other formalism in computer science sharing the same underlying structure. Both the domain free and the labeled view of the information algebra of coherent sets of gambles are presented, considering general possibility spaces.


The complexity of multilayer d dimensional circuits. In this paper we research a model of multilayer circuits with a single logical layer. We consider lambda separable graphs as a support for circuits. We establish the Shannon function lower bound max bigl( frac 2 n n , frac 2 n (1 lambda) log k bigr) for this type of circuits where k is the number of layers. For d dimensional graphs, which are lambda separable for lambda frac d 1 d , this gives the Shannon function lower bound frac 2 n min(n, d log k) . For multidimensional rectangular circuits the proved lower bound asymptotically matches to the upper bound.


Coordinate ordering free Upper Bounds for Linear Insertion Deletion Codes. The insertion deletion codes were motivated to correct the synchronization errors. In this paper we prove several coordinate ordering free upper bounds on the insdel distances of linear codes, which are based on the generalized Hamming weights and the formation of minimum Hamming weight codewords. Our bounds are stronger than some previous known bounds. We apply these upper bounds to some cyclic codes and one algebraic geometric code with any rearrangement of coordinate positions. Some strong upper bounds on the insdel distances of Reed Muller codes with special coordinate ordering are also given.


Upper Bounds on Resolvent Degree and Its Growth Rate. For each n , let text RD (n) denote the minimum d for which there exists a formula for the general polynomial of degree n in algebraic functions of at most d variables. In 1945, Segre called for a better understanding of the large n behavior of text RD (n) . In this paper, we provide improved thresholds for upper bounds on text RD (n) . Our techniques build upon classical algebraic geometry to provide new upper bounds for small n and, in doing so, fix gaps in the proofs of A. Wiman and G.N. Chebotarev in Wim1927 and Che1954 .


Training Aware Sigmoidal Optimizer. Proper optimization of deep neural networks is an open research question since an optimal procedure to change the learning rate throughout training is still unknown. Manually defining a learning rate schedule involves troublesome time consuming try and error procedures to determine hyperparameters such as learning rate decay epochs and learning rate decay rates. Although adaptive learning rate optimizers automatize this process, recent studies suggest they may produce overffiting and reduce performance when compared to fine tuned learning rate schedules. Considering that deep neural networks loss functions present landscapes with much more saddle points than local minima, we proposed the Training Aware Sigmoidal Optimizer (TASO), which consists of a two phases automated learning rate schedule. The first phase uses a high learning rate to fast traverse the numerous saddle point, while the second phase uses low learning rate to slowly approach the center of the local minimum previously found. We compared the proposed approach with commonly used adaptive learning rate schedules such as Adam, RMSProp, and Adagrad. Our experiments showed that TASO outperformed all competing methods in both optimal (i.e., performing hyperparameter validation) and suboptimal (i.e., using default hyperparameters) scenarios.


Normal subgroups of big mapping class groups. Let S be a surface and let Mod(S,K) be the mapping class group of S permuting a Cantor subset K of S. We prove two structure theorems for normal subgroups of Mod(S,K). (Purity ) if S has finite type, every normal subgroup of Mod(S,K) either contains the kernel of the forgetful map to the mapping class group of S, or it is pure', i.e. it fixes the Cantor set pointwise. (Inertia ) for any n element subset Q of the Cantor set, there is a forgetful map from the pure subgroup PMod(S,K) of Mod(S,K) to the mapping class group of (S,Q) fixing Q pointwise. If N is a normal subgroup of Mod(S,K) contained in PMod(S,K), its image N Q is likewise normal. We characterize exactly which finite type normal subgroups N Q arise this way. Several applications and numerous examples are also given.


An Introduction to Robust Graph Convolutional Networks. Graph convolutional neural networks (GCNs) generalize tradition convolutional neural networks (CNNs) from low dimensional regular graphs (e.g., image) to high dimensional irregular graphs (e.g., text documents on word embeddings). Due to inevitable faulty data collection instruments, deceptive data manipulation, or other system errors, the data might be error contaminated. Even a small amount of error such as noise can compromise the ability of GCNs and render them inadmissible to a large extent. The key challenge is how to effectively and efficiently employ GCNs in the presence of erroneous data. In this paper, we propose a novel Robust Graph Convolutional Neural Networks for possible erroneous single view or multi view data where data may come from multiple sources. By incorporating an extra layers via Autoencoders into traditional graph convolutional networks, we characterize and handle typical error models explicitly. Experimental results on various real world datasets demonstrate the superiority of the proposed model over the baseline methods and its robustness against different types of error.


Segmentation in Style Unsupervised Semantic Image Segmentation with Stylegan and CLIP. We introduce a method that allows to automatically segment images into semantically meaningful regions without human supervision. Derived regions are consistent across different images and coincide with human defined semantic classes on some datasets. In cases where semantic regions might be hard for human to define and consistently label, our method is still able to find meaningful and consistent semantic classes. In our work, we use pretrained StyleGAN2 generative model clustering in the feature space of the generative model allows to discover semantic classes. Once classes are discovered, a synthetic dataset with generated images and corresponding segmentation masks can be created. After that a segmentation model is trained on the synthetic dataset and is able to generalize to real images. Additionally, by using CLIP we are able to use prompts defined in a natural language to discover some desired semantic classes. We test our method on publicly available datasets and show state of the art results.


Distributionally Robust Prescriptive Analytics with Wasserstein Distance. In prescriptive analytics, the decision maker observes historical samples of (X, Y) , where Y is the uncertain problem parameter and X is the concurrent covariate, without knowing the joint distribution. Given an additional covariate observation x , the goal is to choose a decision z conditional on this observation to minimize the cost mathbb E c(z,Y) X x . This paper proposes a new distributionally robust approach under Wasserstein ambiguity sets, in which the nominal distribution of Y X x is constructed based on the Nadaraya Watson kernel estimator concerning the historical data. We show that the nominal distribution converges to the actual conditional distribution under the Wasserstein distance. We establish the out of sample guarantees and the computational tractability of the framework. Through synthetic and empirical experiments about the newsvendor problem and portfolio optimization, we demonstrate the strong performance and practical value of the proposed framework.


On the sum of chemical reactions. It is standard in chemistry to represent a sequence of reactions by a single overall reaction, often called a complex reaction in contrast to an elementary reaction. Photosynthesis 6 text CO 2 6 text H 2 text O to text C 6 text H 12 text O 6 6 text O 2 is an example of such complex reaction. We introduce a mathematical operation that corresponds to summing two chemical reactions. Specifically, we define an associative and non communicative operation on the product space mathbb N 0 n times mathbb N 0 n (representing the reactant and the product of a chemical reaction, respectively). The operation models the overall effect of two reactions happening in succession, one after the other. We study the algebraic properties of the operation and apply the results to stochastic reaction networks, in particular to reachability of states, and to reduction of reaction networks.


Sequence Types and Infinitary Semantics. We introduce a new representation of non idempotent intersection types, using textbf sequences (families indexed with natural numbers) instead of lists or multisets. This allows scaling up textbf intersection type theory to the infinitary lambda calculus. We thus characterize hereditary head normalization, which gives a positive answer to a question known as textbf Klop's Problem . On our way, we use textbf non idempotent intersection to retrieve some well known results on infinitary terms.


Speed Benchmarking of Genetic Programming Frameworks. Genetic Programming (GP) is known to suffer from the burden of being computationally expensive by design. While, over the years, many techniques have been developed to mitigate this issue, data vectorization, in particular, is arguably still the most attractive strategy due to the parallel nature of GP. In this work, we employ a series of benchmarks meant to compare both the performance and evolution capabilities of different vectorized and iterative implementation approaches across several existing frameworks. Namely, TensorGP, a novel open source engine written in Python, is shown to greatly benefit from the TensorFlow library to accelerate the domain evaluation phase in GP. The presented performance benchmarks demonstrate that the TensorGP engine manages to pull ahead, with relative speedups above two orders of magnitude for problems with a higher number of fitness cases. Additionally, as a consequence of being able to compute larger domains, we argue that TensorGP performance gains aid the discovery of more accurate candidate solutions.


Eternal Domination and Clique Covering. We study the relationship between the eternal domination number of a graph and its clique covering number using both large scale computation and analytic methods. In doing so, we answer two open questions of Klostermeyer and Mynhardt. We show that the smallest graph having its eternal domination number less than its clique covering number has 10 vertices. We determine the complete set of 10 vertex and 11 vertex graphs having eternal domination numbers less than their clique covering numbers. We show that the smallest triangle free graph with this property has order 13 , as does the smallest circulant graph. We describe a method to generate an infinite family of triangle free graphs and an infinite family of circulant graphs with eternal domination numbers less than their clique covering numbers. We also consider planar graphs and cubic graphs. Finally, we show that for any integer k geq 2 there exist infinitely many graphs having domination number and eternal domination number equal to k containing dominating sets which are not eternal dominating sets.


Mixing of 3 term progressions in Quasirandom Groups. In this note, we show the mixing of three term progressions (x, xg, xg 2) in every finite quasirandom groups, fully answering a question of Gowers. More precisely, we show that for any D quasirandom group G and any three sets A 1, A 2, A 3 subset G , we have left Pr x,y sim G left x in A 1, xy in A 2, xy 2 in A 3 right prod i 1 3 Pr x sim G left x in A i right right leq left( frac 2 sqrt D right) frac 1 4 . Prior to this, Tao answered this question when the underlying quasirandom group is mathrm SL d ( mathbb F q) . Subsequently, Peluse extended the result to all nonabelian finite textit simple groups. In this work, we show that a slight modification of Peluse's argument is sufficient to fully resolve Gower's quasirandom conjecture for 3 term progressions. Surprisingly, unlike the proofs of Tao and Peluse, our proof is elementary and only uses basic facts from nonabelian Fourier analysis.


Agrarian and ell 2 Betti numbers of locally indicable groups, with a twist. We prove that twisted ell 2 Betti numbers of locally indicable groups are equal to the usual ell 2 Betti numbers rescaled by the dimension of the twisting representation this answers a question of L "uck for this class of groups. It also leads to two formulae given a fibration E with base space B having locally indicable fundamental group, and with a simply connected fibre F , the first formula bounds ell 2 Betti numbers b i (2) (E) of E in terms of ell 2 Betti numbers of B and usual Betti numbers of F the second formula computes b i (2) (E) exactly in terms of the same data, provided that F is a high dimensional sphere. We also present an inequality between twisted Alexander and Thurston norms for free by cyclic groups and 3 manifolds. The technical tools we use come from the theory of generalised agrarian invariants, whose study we initiate in this paper.


Sorting OAM modes with metasurfaces based on raytracing improved optical coordinate transformation. Optical coordinate transformation (OCT) has attracted widespread attention in the field of orbital angular momentum (OAM) (de)multiplexing or manipulation, but the performance of OCT would suffer from its distortion. In this paper, we quantitatively analyze the distortion of OCT from the perspective of ray optics, and explain its rationality to work under non normal incident light. For the special case of log polar coordinate transformation (LPCT), we use a raytracing assisted optimization scheme to improve its distortion, which is related to a Zernike polynomial based phase compensation. After raytracing optimization, the root mean square error (RMSE) of the focused rays is reduced to 1 5 of the original value and the physical optic simulation also shows great improvement. In the experiment, we use three phase masks which are realized by metasurfaces, the measured results show well consistency with the simulation. Results in this paper have great potential to improve the performance of OCT related applications.


Interplay between intra urban population density and mobility in determining the spread of epidemics. In this work, we address the connection between population density centers in urban areas, and the nature of human flows between such centers, in shaping the vulnerability to the onset of contagious diseases. A study of 163 cities, chosen from four different continents reveals a universal trend, whereby the risk induced by human mobility increases in those cities where mobility flows are predominantly between high population density centers. We apply our formalism to the spread of SARS COV 2 in the United States, providing a plausible explanation for the observed heterogeneity in the spreading process across cities. Armed with this insight, we propose realistic mitigation strategies (less severe than lockdowns), based on modifying the mobility in cities. Our results suggest that an optimal control strategy involves an asymmetric policy that restricts flows entering the most vulnerable areas but allowing residents to continue their usual mobility patterns.


User Guided Personalized Image Aesthetic Assessment based on Deep Reinforcement Learning. Personalized image aesthetic assessment (PIAA) has recently become a hot topic due to its usefulness in a wide variety of applications such as photography, film and television, e commerce, fashion design and so on. This task is more seriously affected by subjective factors and samples provided by users. In order to acquire precise personalized aesthetic distribution by small amount of samples, we propose a novel user guided personalized image aesthetic assessment framework. This framework leverages user interactions to retouch and rank images for aesthetic assessment based on deep reinforcement learning (DRL), and generates personalized aesthetic distribution that is more in line with the aesthetic preferences of different users. It mainly consists of two stages. In the first stage, personalized aesthetic ranking is generated by interactive image enhancement and manual ranking, meanwhile two policy networks will be trained. The images will be pushed to the user for manual retouching and simultaneously to the enhancement policy network. The enhancement network utilizes the manual retouching results as the optimization goals of DRL. After that, the ranking process performs the similar operations like the retouching mentioned before. These two networks will be trained iteratively and alternatively to help to complete the final personalized aesthetic assessment automatically. In the second stage, these modified images are labeled with aesthetic attributes by one style specific classifier, and then the personalized aesthetic distribution is generated based on the multiple aesthetic attributes of these images, which conforms to the aesthetic preference of users better.


Optimal Action based or User Prediction based Haptic Guidance Can You Do Even Better?. The recently advanced robotics technology enables robots to assist users in their daily lives. Haptic guidance (HG) improves users' task performance through physical interaction between robots and users. It can be classified into optimal action based HG (OAHG), which assists users with an optimal action, and user prediction based HG (UPHG), which assists users with their next predicted action. This study aims to understand the difference between OAHG and UPHG and propose a combined HG (CombHG) that achieves optimal performance by complementing each HG type, which has important implications for HG design. We propose implementation methods for each HG type using deep learning based approaches. A user study (n 20) in a haptic task environment indicated that UPHG induces better subjective evaluations, such as naturalness and comfort, than OAHG. In addition, the CombHG that we proposed further decreases the disagreement between the user intention and HG, without reducing the objective and subjective scores.


Is the aspect ratio of cells important in deep learning? A robust comparison of deep learning methods for multi scale cytopathology cell image classification from convolutional neural networks to visual transformers. Cervical cancer is a very common and fatal type of cancer in women. Cytopathology images are often used to screen for this cancer. Given that there is a possibility that many errors can occur during manual screening, a computer aided diagnosis system based on deep learning has been developed. Deep learning methods require a fixed dimension of input images, but the dimensions of clinical medical images are inconsistent. The aspect ratios of the images suffer while resizing them directly. Clinically, the aspect ratios of cells inside cytopathological images provide important information for doctors to diagnose cancer. Therefore, it is difficult to resize directly. However, many existing studies have resized the images directly and have obtained highly robust classification results. To determine a reasonable interpretation, we have conducted a series of comparative experiments. First, the raw data of the SIPaKMeD dataset are pre processed to obtain standard and scaled datasets. Then, the datasets are resized to 224 x 224 pixels. Finally, 22 deep learning models are used to classify the standard and scaled datasets. The results of the study indicate that deep learning models are robust to changes in the aspect ratio of cells in cervical cytopathological images. This conclusion is also validated via the Herlev dataset.


Manipulability optimization for multi arm teleoperation. Teleoperation provides a way for human operators to guide robots in situations where full autonomy is challenging or where direct human intervention is required. It can also be an important tool to teach robots in order to achieve autonomous behaviour later on. The increased availability of collaborative robot arms and Virtual Reality (VR) devices provides ample opportunity for development of novel teleoperation methods. Since robot arms are often kinematically different from human arms, mapping human motions to a robot in real time is not trivial. Additionally, a human operator might steer the robot arm toward singularities or its workspace limits, which can lead to undesirable behaviour. This is further accentuated for the orchestration of multiple robots. In this paper, we present a VR interface targeted to multi arm payload manipulation, which can closely match real time input motion. Allowing the user to manipulate the payload rather than mapping their motions to individual arms we are able to simultaneously guide multiple collaborative arms. By releasing a single rotational degree of freedom, and by using a local optimization method, we can improve each arm's manipulability index, which in turn lets us avoid kinematic singularities and workspace limitations. We apply our approach to predefined trajectories as well as real time teleoperation on different robot arms and compare performance in terms of end effector position error and relevant joint motion metrics.


HaptiStylus A Novel Stylus Capable of Displaying Movement and Rotational Torque Effects. With the emergence of pen enabled tablets and mobile devices, stylus based interaction has been receiving increasing attention. Unfortunately, styluses available in the market today are all passive instruments that are primarily used for writing and pointing. In this paper, we describe a novel stylus capable of displaying certain vibro tactile and inertial haptic effects to the user. Our stylus is equipped with two vibration actuators at the ends, which are used to create a tactile sensation of up and down movement along the stylus. The stylus is also embedded with a DC motor, which is used to create a sense of bidirectional rotational torque about the long axis of the pen. Through two psychophysical experiments, we show that, when driven with carefully selected timing and actuation patterns, our haptic stylus can convey movement and rotational torque information to the user. Results from a further psychophysical experiment provide insight on how the shape of the actuation patterns effects the perception of rotational torque effect. Finally, experimental results from our interactive pen based game show that our haptic stylus is effective in practical settings


A Survey on Interpretable Reinforcement Learning. Although deep reinforcement learning has become a promising machine learning approach for sequential decision making problems, it is still not mature enough for high stake domains such as autonomous driving or medical applications. In such contexts, a learned policy needs for instance to be interpretable, so that it can be inspected before any deployment (e.g., for safety and verifiability reasons). This survey provides an overview of various approaches to achieve higher interpretability in reinforcement learning (RL). To that aim, we distinguish interpretability (as a property of a model) and explainability (as a post hoc operation, with the intervention of a proxy) and discuss them in the context of RL with an emphasis on the former notion. In particular, we argue that interpretable RL may embrace different facets interpretable inputs, interpretable (transition reward) models, and interpretable decision making. Based on this scheme, we summarize and analyze recent work related to interpretable RL with an emphasis on papers published in the past 10 years. We also discuss briefly some related research areas and point to some potential promising research directions.


On the role of the Fibonacci matrix as key in modified ECC. In this paper, we have proposed a modified cryptographic scheme based on the application of recursive matrices as key in ECC and ElGamal. For encryption, we consider mapping analogous to affine Hill cipher in which a plaintext matrix has been constructed by points corresponding to letters on elliptic curves. In the formation of key space, the generalized Fibonacci matrices have been taken into account, which is the sequence of matrices. The beauty of considering Fibonacci matrices is their construction where we need only two parameters(integers) in place of n 2 elements. The use of a recursive matrix makes a large keyspace for our proposed scheme and increases its efficiency. Thus, it reduces time as well space complexity, and its security strength is based on EC DLP which is a hard problem in number theory.


EmoconLite Bridging the Gap Between Emotiv and Play for Children With Severe Disabilities. Brain computer interfaces (BCIs) allow users to control computer applications by modulating their brain activity. Since BCIs rely solely on brain activity, they have enormous potential as an alternative access method for engaging children with severe disabilities and or medical complexities in therapeutic recreation and leisure. In particular, one commercially available BCI platform is the Emotiv EPOC headset, which is a portable and affordable electroencephalography (EEG) device. Combined with the EmotivBCI software, the Emotiv system can generate a model to discern between different mental tasks based on the user's EEG signals in real time. While the Emotiv system shows promise for use by the pediatric population in the setting of a BCI clinic, it lacks integrated support that allows users to directly control computer applications using the generated classification output. To achieve this, users would have to create their own program, which can be challenging for those who may not be technologically inclined. To address this gap, we developed a freely available and user friendly BCI software application called EmoconLite. Using the classification output from EmotivBCI, EmoconLite allows users to play YouTube video clips and a variety of video games from multiple platforms, ultimately creating an end to end solution for users. Through its deployment in the Holland Bloorview Kids Rehabilitation Hospital's BCI clinic, EmoconLite is bridging the gap between research and clinical practice, providing children with access to BCI technology and supporting BCI enabled play.


Evaluating the Correctness of Explainable AI Algorithms for Classification. Explainable AI has attracted much research attention in recent years with feature attribution algorithms, which compute "feature importance" in predictions, becoming increasingly popular. However, there is little analysis of the validity of these algorithms as there is no "ground truth" in the existing datasets to validate their correctness. In this work, we develop a method to quantitatively evaluate the correctness of XAI algorithms by creating datasets with known explanation ground truth. To this end, we focus on the binary classification problems. String datasets are constructed using formal language derived from a grammar. A string is positive if and only if a certain property is fulfilled. Symbols serving as explanation ground truth in a positive string are part of an explanation if and only if they contributes to fulfilling the property. Two popular feature attribution explainers, Local Interpretable Model agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP), are used in our experiments.We show that (1) classification accuracy is positively correlated with explanation accuracy (2) SHAP provides more accurate explanations than LIME (3) explanation accuracy is negatively correlated with dataset complexity.


See through Gradients Image Batch Recovery via GradInversion. Training deep neural networks requires gradient estimation from data batches to update parameters. Gradients per parameter are averaged over a set of data and this has been presumed to be safe for privacy preserving training in joint, collaborative, and federated learning applications. Prior work only showed the possibility of recovering input data given gradients under very restrictive conditions a single input point, or a network with no non linearities, or a small 32x32 px input batch. Therefore, averaging gradients over larger batches was thought to be safe. In this work, we introduce GradInversion, using which input images from a larger batch (8 48 images) can also be recovered for large networks such as ResNets (50 layers), on complex datasets such as ImageNet (1000 classes, 224x224 px). We formulate an optimization task that converts random noise into natural images, matching gradients while regularizing image fidelity. We also propose an algorithm for target class label recovery given gradients. We further propose a group consistency regularization framework, where multiple agents starting from different random seeds work together to find an enhanced reconstruction of original data batch. We show that gradients encode a surprisingly large amount of information, such that all the individual images can be recovered with high fidelity via GradInversion, even for complex datasets, deep networks, and large batch sizes.


Hybrid Beamforming Optimization for DOA Estimation Based on the CRB Analysis. Direction of arrival (DOA) estimation is one of the most demanding tasks for the millimeter wave (mmWave) communication of massive multiple input multiple output (MIMO) systems with the hybrid beamforming (HBF) architecture. In this paper, we focus on the optimization of the HBF matrix for receiving pilots to enhance the DOA estimation performance. Motivated by the fact that many existing DOA estimation algorithms can achieve the Cram ' e r Rao bound (CRB), we formulate the HBF optimization problem aiming at minimizing the CRB with the prior knowledge of the rough DOA range. Then, to tackle the problem with intractable non convex constraint introduced by the analog beamformers, we propose an efficient manifold optimization (MO) based algorithm. Simulation results demonstrate the significant improvement of the proposed CRB MO algorithm over the conventional random HBF algorithm, and provide insights for the HBF design in the beam training stage for practical applications.