Three dimensional deep learning based reduced order model for unsteady flow dynamics with variable Reynolds number. We present a deep learning based reduced order model (DL ROM) for predicting the fluid forces and unsteady vortex patterns. We consider flow past a sphere to examine the accuracy of our DL ROM predictions. The proposed methodology relies on a three dimensional convolutional recurrent autoencoder network (3D CRAN) to extract the low dimensional flow features from full order snapshots. The low dimensional features are evolved in time using a long short term memory based recurrent neural network and reconstructed back to the full order as flow voxels. These 3D voxels are introduced as static and uniform query probes in the point cloud domain to reduce the unstructured mesh complexity while providing convenience in 3D CRAN training. We analyze a novel procedure to recover the interface description and the force quantities from the 3D flow voxels. The 3D CRAN methodology is first applied to an external flow past a static sphere at a single Reynolds number of Re 300. We provide an assessment of the computing requirements in terms of the memory usage, training costs, and testing times associated with the 3D CRAN framework. Subsequently, variable Re based flow information is infused in one 3D CRAN to learn a complicated symmetry breaking flow regime (280 Re 460) for the flow past a sphere. Effects of transfer learning are analyzed for training this complicated 3D flow regime on a relatively smaller time series dataset. The 3D CRAN framework learns the flow regime nearly 20 times faster than the parallel full order model and predicts unsteady flows with an excellent to good accuracy. Based on the predicted flow fields, the network demonstrates an R2 accuracy of 98.58 for drag and 76.43 for lift over the sphere in the chosen flow regime. The proposed framework aligns with the development of a digital twin for 3D unsteady flow field with variable Re effects.


Signed graphs with maximal index. The index of a signed graph is the largest eigenvalue of its adjacency matrix. For positive integers n and m le n 2 4 , we determine the maximal index of complete signed graphs with n vertices and m negative edges. This settles (the corrected version of) a conjecture by Koledin and Stani 'c (2017).


Implicit Unlikelihood Training Improving Neural Text Generation with Reinforcement Learning. Likelihood training and maximization based decoding result in dull and repetitive generated texts even when using powerful language models (Holtzman et al., 2019). Adding a loss function for regularization was shown to improve text generation output by helping avoid unwanted properties, such as contradiction or repetition (Li at al., 2020). In this work, we propose fine tuning a language model by using policy gradient reinforcement learning, directly optimizing for better generation. We apply this approach to minimizing repetition in generated text, and show that, when combined with unlikelihood training (Welleck et al., 2020), our method further reduces repetition without impacting the language model quality. We also evaluate other methods for improving generation at training and decoding time, and compare them using various metrics aimed at control for better text generation output.


On the power of adaptivity in statistical adversaries. We study a fundamental question concerning adversarial noise models in statistical problems where the algorithm receives i.i.d. draws from a distribution mathcal D . The definitions of these adversaries specify the type of allowable corruptions (noise model) as well as when these corruptions can be made (adaptivity) the latter differentiates between oblivious adversaries that can only corrupt the distribution mathcal D and adaptive adversaries that can have their corruptions depend on the specific sample S that is drawn from mathcal D . In this work, we investigate whether oblivious adversaries are effectively equivalent to adaptive adversaries, across all noise models studied in the literature. Specifically, can the behavior of an algorithm mathcal A in the presence of oblivious adversaries always be well approximated by that of an algorithm mathcal A ' in the presence of adaptive adversaries? Our first result shows that this is indeed the case for the broad class of statistical query algorithms, under all reasonable noise models. We then show that in the specific case of additive noise, this equivalence holds for all algorithms. Finally, we map out an approach towards proving this statement in its fullest generality, for all algorithms and under all reasonable noise models.


Combiner Full Attention Transformer with Sparse Computation Cost. Transformers provide a class of expressive architectures that are extremely effective for sequence modeling. However, the key limitation of transformers is their quadratic memory and time complexity mathcal O (L 2) with respect to the sequence length in attention layers, which restricts application in extremely long sequences. Most existing approaches leverage sparsity or low rank assumptions in the attention matrix to reduce cost, but sacrifice expressiveness. Instead, we propose Combiner, which provides full attention capability in each attention head while maintaining low computation and memory complexity. The key idea is to treat the self attention mechanism as a conditional expectation over embeddings at each location, and approximate the conditional distribution with a structured factorization. Each location can attend to all other locations, either via direct attention, or through indirect attention to abstractions, which are again conditional expectations of embeddings from corresponding local regions. We show that most sparse attention patterns used in existing sparse transformers are able to inspire the design of such factorization for full attention, resulting in the same sub quadratic cost ( mathcal O (L log(L)) or mathcal O (L sqrt L ) ). Combiner is a drop in replacement for attention layers in existing transformers and can be easily implemented in common frameworks. An experimental evaluation on both autoregressive and bidirectional sequence tasks demonstrates the effectiveness of this approach, yielding state of the art results on several image and text modeling tasks.


On Search Complexity of Discrete Logarithm. In this work, we study the discrete logarithm problem in the context of TFNP the complexity class of search problems with a syntactically guaranteed existence of a solution for all instances. Our main results establish that suitable variants of the discrete logarithm problem are complete for the complexity class PPP, respectively PWPP, i.e., the subclasses of TFNP capturing total search problems with a solution guaranteed by the pigeonhole principle, respectively the weak pigeonhole principle. Besides answering an open problem from the recent work of Sotiraki, Zampetakis, and Zirdelis (FOCS'18), our completeness results for PPP and PWPP have implications for the recent line of work proving conditional lower bounds for problems in TFNP under cryptographic assumptions. In particular, they highlight that any attempt at basing average case hardness in subclasses of TFNP (other than PWPP and PPP) on the average case hardness of the discrete logarithm problem must exploit its structural properties beyond what is necessary for constructions of collision resistant hash functions. Additionally, our reductions provide new structural insights into the class PWPP by establishing two new PWPP complete problems. First, the problem DOVE, a relaxation of the PPP complete problem PIGEON. DOVE is the first PWPP complete problem not defined in terms of an explicitly shrinking function. Second, the problem CLAW, a total search problem capturing the computational complexity of breaking claw free permutations. In the context of TFNP, the PWPP completeness of CLAW matches the known intrinsic relationship between collision resistant hash functions and claw free permutations established in the cryptographic literature.


Gyrogroup through its Grothendieck Group Completion and Right gyrogroup action. In this article, we discuss the Grothendieck group completion (GGC) of a gyrogroup. Consequently, we show that there is a one to one correspondence between actions and representations of a gyrogroup, and actions and representations of its Grothendieck group completion. We also introduce the concept of an action of a right gyrogroup.


Practical Distributed Control for VTOL UAVs to Pass a Virtual Tube. Unmanned Aerial Vehicles (UAVs) are now becoming increasingly accessible to amateur and commercial users alike. An air traffic management (ATM) system is needed to help ensure that this newest entrant into the skies does not collide with others. In an ATM, airspace can be composed of airways, intersections and nodes. In this paper, for simplicity, distributed coordinating the motions of Vertical TakeOff and Landing (VTOL) UAVs to pass an airway is focused. This is formulated as a virtual tube passing problem, which includes passing a virtual tube, inter agent collision avoidance and keeping within the virtual tube. Lyapunov like functions are designed elaborately, and formal analysis based on invariant set theorem is made to show that all UAVs can pass the virtual tube without getting trapped, avoid collision and keep within the virtual tube. What is more, by the proposed distributed control, a VTOL UAV can keep away from another VTOL UAV or return back to the virtual tube as soon as possible, once it enters into the safety area of another or has a collision with the virtual tube during it is passing the virtual tube. Simulations and experiments are carried out to show the effectiveness of the proposed method and the comparison with other methods.


Gravity Optimizer a Kinematic Approach on Optimization in Deep Learning. We introduce Gravity, another algorithm for gradient based optimization. In this paper, we explain how our novel idea change parameters to reduce the deep learning model's loss. It has three intuitive hyper parameters that the best values for them are proposed. Also, we propose an alternative to moving average. To compare the performance of the Gravity optimizer with two common optimizers, Adam and RMSProp, five standard datasets were trained on two VGGNet models with a batch size of 128 for 100 epochs. Gravity hyper parameters did not need to be tuned for different models. As will be explained more in the paper, to investigate the direct impact of the optimizer itself on loss reduction no overfitting prevention technique was used. The obtained results show that the Gravity optimizer has more stable performance than Adam and RMSProp and gives greater values of validation accuracy for datasets with more output classes like CIFAR 100 (Fine).


On a "Wonderful" Bruhat Tits group scheme. In this note we make a universal construction of Bruhat Tits group scheme on wonderful embeddings of adjoint groups in the absolute and relative settings and of adjoint Kac Moody groups. These have natural classifying properties reflecting the orbit structure on the wonderful embeddings.


Adversarial Attack on Network Embeddings via Supervised Network Poisoning. Learning low level node embeddings using techniques from network representation learning is useful for solving downstream tasks such as node classification and link prediction. An important consideration in such applications is the robustness of the embedding algorithms against adversarial attacks, which can be examined by performing perturbation on the original network. An efficient perturbation technique can degrade the performance of network embeddings on downstream tasks. In this paper, we study network embedding algorithms from an adversarial point of view and observe the effect of poisoning the network on downstream tasks. We propose VIKING, a supervised network poisoning strategy that outperforms the state of the art poisoning methods by upto 18 on the original network structure. We also extend VIKING to a semi supervised attack setting and show that it is comparable to its supervised counterpart.


Tuiteamos o pongamos un tuit? Investigating the Social Constraints of Loanword Integration in Spanish Social Media. Speakers of non English languages often adopt loanwords from English to express new or unusual concepts. While these loanwords may be borrowed unchanged, speakers may also integrate the words to fit the constraints of their native language, e.g. creating Spanish "tuitear" from English "tweet." Linguists have often considered the process of loanword integration to be more dependent on language internal constraints, but sociolinguistic constraints such as speaker background remain only qualitatively understood. We investigate the role of social context and speaker background in Spanish speakers' use of integrated loanwords on social media. We find first that newspaper authors use the integrated forms of loanwords and native words more often than social media authors, showing that integration is associated with formal domains. In social media, we find that speaker background and expectations of formality explain loanword and native word integration, such that authors who use more Spanish and who write to a wider audience tend to use integrated verb forms more often. This study shows that loanword integration reflects not only language internal constraints but also social expectations that vary by conversation and speaker.


On the Complexity of Computing Markov Perfect Equilibrium in General Sum Stochastic Games. Similar to the role of Markov decision processes in reinforcement learning, Stochastic Games (SGs) lay the foundation for the study of multi agent reinforcement learning (MARL) and sequential agent interactions. In this paper, we derive that computing an approximate Markov Perfect Equilibrium (MPE) in a finite state discounted Stochastic Game within the exponential precision is textbf PPAD complete. We adopt a function with a polynomially bounded description in the strategy space to convert the MPE computation to a fixed point problem, even though the stochastic game may demand an exponential number of pure strategies, in the number of states, for each agent. The completeness result follows the reduction of the fixed point problem to sc End of the Line . Our results indicate that finding an MPE in SGs is highly unlikely to be textbf NP hard unless textbf NP textbf co NP . Our work offers confidence for MARL research to study MPE computation on general sum SGs and to develop fruitful algorithms as currently on zero sum SGs.


Recurrent Neural Networks for Stochastic Control Problems with Delay. Stochastic control problems with delay are challenging due to the path dependent feature of the system and thus its intrinsic high dimensions. In this paper, we propose and systematically study deep neural networks based algorithms to solve stochastic control problems with delay features. Specifically, we employ neural networks for sequence modeling ( emph e.g. , recurrent neural networks such as long short term memory) to parameterize the policy and optimize the objective function. The proposed algorithms are tested on three benchmark examples a linear quadratic problem, optimal consumption with fixed finite delay, and portfolio optimization with complete memory. Particularly, we notice that the architecture of recurrent neural networks naturally captures the path dependent feature with much flexibility and yields better performance with more efficient and stable training of the network compared to feedforward networks. The superiority is even evident in the case of portfolio optimization with complete memory, which features infinite delay.


Fast Data Series Indexing for In Memory Data. Data series similarity search is a core operation for several data series analysis applications across many different domains. However, the state of the art techniques fail to deliver the time performance required for interactive exploration, or analysis of large data series collections. In this work, we propose MESSI, the first data series index designed for in memory operation on modern hardware. Our index takes advantage of the modern hardware parallelization opportunities (i.e., SIMD instructions, multi socket and multi core architectures), in order to accelerate both index construction and similarity search processing times. Moreover, it benefits from a careful design in the setup and coordination of the parallel workers and data structures, so that it maximizes its performance for in memory operations. MESSI supports similarity search using both the Euclidean and Dynamic Time Warping (DTW) distances. Our experiments with synthetic and real datasets demonstrate that overall MESSI is up to 4x faster at index construction, and up to 11x faster at query answering than the state of the art parallel approach. MESSI is the first to answer exact similarity search queries on 100GB datasets in 50msec (30 75msec across diverse datasets), which enables real time, interactive data exploration on very large data series collections.


Observation of higher order exceptional points in a non local acoustic metagrating. Higher order exceptional points have attracted increased attention in recent years due to their enhanced sensitivity and distinct topological features. Here, we show that nonlocal acoustic metagratings that enable precise and simultaneous control over their muliple orders of diffraction, can serve as a robust platform for investigating higher order exceptional points in free space. The proposed metagratings, not only could advance the fundamental research of arbitrary order exceptional points, but could also empower unconventional free space wave manipulation for applications related to sensing and extremely asymmetrical wave control.


Urban land use analysis using proximate sensing imagery a survey. Urban regions are complicated functional systems that are closely associated with and reshaped by human activities. The propagation of online geographic information sharing platforms and mobile devices equipped with Global Positioning System (GPS) greatly proliferates proximate sensing images taken near or on the ground at a close distance to urban targets. Studies leveraging proximate sensing imagery have demonstrated great potential to address the need for local data in urban land use analysis. This paper reviews and summarizes the state of the art methods and publicly available datasets from proximate sensing to support land use analysis. We identify several research problems in the perspective of examples to support training of models and means of integrating diverse data sets. Our discussions highlight the challenges, strategies, and opportunities faced by the existing methods using proximate sensing imagery in urban land use studies.


Error analysis for a parabolic PDE model problem on a coupled moving domain in a fully Eulerian framework. We introduce an unfitted finite element method with Lagrange multipliers to study an Eulerian time stepping scheme for moving domain problems applied to a model problem where the domain motion is implicit to the problem. We consider a parabolic partial differential equation (PDE) in the bulk domain, and the domain motion is described by an ordinary differential equation (ODE), coupled to the bulk partial differential equation through the transfer of forces at the moving interface. The discretisation is based on an unfitted finite element discretisation on a time independent mesh. The method of lines time discretisation is enabled by an implicit extension of the bulk solution through additional stabilisation, as introduced by Lehrenfeld Olshanskii (ESAIM M2AN, 53 585 614, 2019). The analysis of the coupled problem relies on the Lagrange multiplier formulation, the fact that the Lagrange multiplier solution is equal to the normal stress at the interface and that the motion of the interface is given through rigid body motion. This paper covers the complete stability analysis of the method and an error estimate in the energy norm. This includes the dynamic error in the domain motion resulting from the discretised ODE and the forces from the discretised PDE. To the best of our knowledge this is the first error analysis of this type of coupled moving domain problem in a fully Eulerian framework. Numerical examples illustrate the theoretical results.


PORTFILER Port Level Network Profiling for Self Propagating Malware Detection. Recent self propagating malware (SPM) campaigns compromised hundred of thousands of victim machines on the Internet. It is challenging to detect these attacks in their early stages, as adversaries utilize common network services, use novel techniques, and can evade existing detection mechanisms. We propose PORTFILER (PORT Level Network Traffic ProFILER), a new machine learning system applied to network traffic for detecting SPM attacks. PORTFILER extracts port level features from the Zeek connection logs collected at a border of a monitored network, applies anomaly detection techniques to identify suspicious events, and ranks the alerts across ports for investigation by the Security Operations Center (SOC). We propose a novel ensemble methodology for aggregating individual models in PORTFILER that increases resilience against several evasion strategies compared to standard ML baselines. We extensively evaluate PORTFILER on traffic collected from two university networks, and show that it can detect SPM attacks with different patterns, such as WannaCry and Mirai, and performs well under evasion. Ranking across ports achieves precision over 0.94 with low false positive rates in the top ranked alerts. When deployed on the university networks, PORTFILER detected anomalous SPM like activity on one of the campus networks, confirmed by the university SOC as malicious. PORTFILER also detected a Mirai attack recreated on the two university networks with higher precision and recall than deep learning based autoencoder methods.


Divisorial and geometric gonality of higher rank tropical curves. We consider a notion of metric graphs where edge lengths take values in a commutative monoid, as a higher rank generalisation of the notion of a tropical curve. Divisorial gonality, which Baker and Norine defined on combinatorial graphs in terms of a chip firing game, is extended to these monoid metrised graphs. We define geometric gonality of a metric graph as the minimal degree of a horizontally conformal, non degenerate morphism onto a metric tree, and prove that geometric gonality is an upper bound for divisorial gonality in the metric case. We relate this to the minimal degree of a map between logarithmic curves.


Structure Aware Feature Generation for Zero Shot Learning. Zero Shot Learning (ZSL) targets at recognizing unseen categories by leveraging auxiliary information, such as attribute embedding. Despite the encouraging results achieved, prior ZSL approaches focus on improving the discriminant power of seen class features, yet have largely overlooked the geometric structure of the samples and the prototypes. The subsequent attribute based generative adversarial network (GAN), as a result, also neglects the topological information in sample generation and further yields inferior performances in classifying the visual features of unseen classes. In this paper, we introduce a novel structure aware feature generation scheme, termed as SA GAN, to explicitly account for the topological structure in learning both the latent space and the generative networks. Specifically, we introduce a constraint loss to preserve the initial geometric structure when learning a discriminative latent space, and carry out our GAN training with additional supervising signals from a structure aware discriminator and a reconstruction module. The former supervision distinguishes fake and real samples based on their affinity to class prototypes, while the latter aims to reconstruct the original feature space from the generated latent space. This topology preserving mechanism enables our method to significantly enhance the generalization capability on unseen classes and consequently improve the classification performance. Experiments on four benchmarks demonstrate that the proposed approach consistently outperforms the state of the art. Our code can be found in the supplementary material and will also be made publicly available.


Cross time functional connectivity analysis. A large body of literature has shown the substantial inter regional functional connectivity in the mammal brain. One important property remaining un studied is the cross time interareal connection. This paper serves to provide a tool to characterize the cross time functional connectivity. The method is extended from the temporal embedding based brain temporal coherence analysis. Both synthetic data and in vivo data were used to evaluate the various properties of the cross time functional connectivity matrix, which is also called the cross regional temporal coherence matrix.


An Experimental Analysis of Graph Distance Algorithms for Comparing API Usages. Modern software development heavily relies on the reuse of functionalities through Application Programming Interfaces (APIs). However, client developers can have issues identifying the correct usage of a certain API, causing misuses accompanied by software crashes or usability bugs. Therefore, researchers have aimed at identifying API misuses automatically by comparing client code usages to correct API usages. Some techniques rely on certain API specific graph based data structures to improve the abstract representation of API usages. Such techniques need to compare graphs, for instance, by computing distance metrics based on the minimal graph edit distance or the largest common subgraphs, whose computations are known to be NP hard problems. Fortunately, there exist many abstractions for simplifying graph distance computation. However, their applicability for comparing graph representations of API usages has not been analyzed. In this paper, we provide a comparison of different distance algorithms of API usage graphs regarding correctness and runtime. Particularly, correctness relates to the algorithms' ability to identify similar correct API usages, but also to discriminate similar correct and false usages as well as non similar usages. For this purpose, we systematically identified a set of eight graph based distance algorithms and applied them on two datasets of real world API usages and misuses. Interestingly, our results suggest that existing distance algorithms are not reliable for comparing API usage graphs. To improve on this situation, we identified and discuss the algorithms' issues, based on which we formulate hypotheses to initiate research on overcoming them.


Gender Specific Patterns in the Artificial Intelligence Scientific Ecosystem. Gender disparity in science is one of the most focused debating points among authorities and the scientific community. Over the last few decades, numerous initiatives have endeavored to accelerate gender equity in academia and research society. However, despite the ongoing efforts, gaps persist across the world, and more measures need to be taken. Using social network analysis, natural language processing, and machine learning, in this study, we comprehensively analyzed gender specific patterns in the highly interdisciplinary and evolving field of artificial intelligence for the period of 2000 2019. Our findings suggest an overall increasing rate of mixed gender collaborations. From the observed gender specific collaborative patterns, the existence of disciplinary homophily at both dyadic and team levels is confirmed. However, a higher preference was observed for female researchers to form homophilous collaborative links. Our core periphery analysis indicated a significant positive association between having diverse collaboration and scientific performance and experience. We found evidence in support of expecting the rise of new female superstar researchers in the artificial intelligence field.


Goal Agnostic Planning using Maximum Likelihood Paths in Hypergraph World Models. In this paper, we present a hypergraph based machine learning algorithm, a datastructure driven maintenance method, and a planning algorithm based on a probabilistic application of Dijkstra's algorithm. Together, these form a goal agnostic automated planning engine for an autonomous learning agent which incorporates beneficial properties of both classical Machine Learning and traditional Artificial Intelligence. We prove that the algorithm determines optimal solutions within the problem space, mathematically bound learning performance, and supply a mathematical model analyzing system state progression through time yielding explicit predictions for learning curves, goal achievement rates, and response to abstractions and uncertainty. To validate performance, we exhibit results from applying the agent to three archetypal planning problems, including composite hierarchical domains, and highlight empirical findings which illustrate properties elucidated in the analysis.


Mean Value and comparative convex functions. During the study of the topic of limit summability of functions (introduced by the author in 2001), we encountered some types of functions that are related to the mean value theorem. In this paper, we formally define mean value and pointwise MV functions associated with a given real function and extend some aspects of the mean value theorem and properties. Also, we introduce and study an induced conception which we call comparative convexity (and concavity). As many applications of the study, we prove some uniqueness conditions for related functional equations and completely solve several functional inequalities. It is worth noting that there remain some important open problems and questions for future studies of the topic.


Neuromorphic adaptive spiking CPG towards bio inspired locomotion of legged robots. In recent years, locomotion mechanisms exhibited by vertebrate animals have been the inspiration for the improvement in the performance of robotic systems. These mechanisms include the adaptability of their locomotion to any change registered in the environment through their biological sensors. In this regard, we aim to replicate such kind of adaptability in legged robots through a Spiking Central Pattern Generator. This Spiking Central Pattern Generator generates different locomotion (rhythmic) patterns which are driven by an external stimulus, that is, the output of a Force Sensitive Resistor connected to the robot to provide feedback. The Spiking Central Pattern Generator consists of a network of five populations of Leaky Integrate and Fire neurons designed with a specific topology in such a way that the rhythmic patterns can be generated and driven by the aforementioned external stimulus. Therefore, the locomotion of the end robotic platform (any legged robot) can be adapted to the terrain by using any sensor as input. The Spiking Central Pattern Generator with adaptive learning has been numerically validated at software and hardware level, using the Brian 2 simulator and the SpiNNaker neuromorphic platform for the latest. In particular, our experiments clearly show an adaptation in the oscillation frequencies between the spikes produced in the populations of the Spiking Central Pattern Generator while the input stimulus varies. To validate the robustness and adaptability of the Spiking Central Pattern Generator, we have performed several tests by variating the output of the sensor. These experiments were carried out in Brian 2 and SpiNNaker both implementations showed a similar behavior with a Pearson correlation coefficient of 0.905.


Asymptotically sharp discrete nonlinear Hausdorff Young inequalities for the SU(1,1) valued Fourier products. We work in a discrete model of the nonlinear Fourier transform (following the terminology of Tao and Thiele), which appears in the study of orthogonal polynomials on the unit circle. The corresponding nonlinear variant of the Hausdorff Young inequality can be deduced by adapting the ideas of Christ and Kiselev to the present discrete setting. However, the behavior of sharp constants remains largely unresolved. In this short note we give two results on these constants, after restricting our attention to either sufficiently small sequences or to sequences that are far from being the extremizers of the linear Hausdorff Young inequality.


Two Faced Humans on Twitter and Facebook Harvesting Social Multimedia for Human Personality Profiling. Human personality traits are the key drivers behind our decision making, influencing our life path on a daily basis. Inference of personality traits, such as Myers Briggs Personality Type, as well as an understanding of dependencies between personality traits and users' behavior on various social media platforms is of crucial importance to modern research and industry applications. The emergence of diverse and cross purpose social media avenues makes it possible to perform user personality profiling automatically and efficiently based on data represented across multiple data modalities. However, the research efforts on personality profiling from multi source multi modal social media data are relatively sparse, and the level of impact of different social network data on machine learning performance has yet to be comprehensively evaluated. Furthermore, there is not such dataset in the research community to benchmark. This study is one of the first attempts towards bridging such an important research gap. Specifically, in this work, we infer the Myers Briggs Personality Type indicators, by applying a novel multi view fusion framework, called "PERS" and comparing the performance results not just across data modalities but also with respect to different social network data sources. Our experimental results demonstrate the PERS's ability to learn from multi view data for personality profiling by efficiently leveraging on the significantly different data arriving from diverse social multimedia sources. We have also found that the selection of a machine learning approach is of crucial importance when choosing social network data sources and that people tend to reveal multiple facets of their personality in different social media avenues. Our released social multimedia dataset facilitates future research on this direction.


Participatory Budgeting with Donations and Diversity Constraints. Participatory budgeting (PB) is a democratic process where citizens jointly decide on how to allocate public funds to indivisible projects. This paper focuses on PB processes where citizens may give additional money to projects they want to see funded. We introduce a formal framework for this kind of PB with donations. Our framework also allows for diversity constraints, meaning that each project belongs to one or more types, and there are lower and upper bounds on the number of projects of the same type that can be funded. We propose three general classes of methods for aggregating the citizens' preferences in the presence of donations and analyze their axiomatic properties. Furthermore, we investigate the computational complexity of determining the outcome of a PB process with donations and of finding a citizen's optimal donation strategy.


Modeling human intention inference in continuous 3D domains by inverse planning and body kinematics. How to build AI that understands human intentions, and uses this knowledge to collaborate with people? We describe a computational framework for evaluating models of goal inference in the domain of 3D motor actions, which receives as input the 3D coordinates of an agent's body, and of possible targets, to produce a continuously updated inference of the intended target. We evaluate our framework in three behavioural experiments using a novel Target Reaching Task, in which human observers infer intentions of actors reaching for targets among distracts. We describe Generative Body Kinematics model, which predicts human intention inference in this domain using Bayesian inverse planning and inverse body kinematics. We compare our model to three heuristics, which formalize the principle of least effort using simple assumptions about the actor's constraints, without the use of inverse planning. Despite being more computationally costly, the Generative Body Kinematics model outperforms the heuristics in certain scenarios, such as environments with obstacles, and at the beginning of reaching actions while the actor is relatively far from the intended target. The heuristics make increasingly accurate predictions during later stages of reaching actions, such as, when the intended target is close, and can be inferred by extrapolating the wrist trajectory. Our results identify contexts in which inverse body kinematics is useful for intention inference. We show that human observers indeed rely on inverse body kinematics in such scenarios, suggesting that modeling body kinematic can improve performance of inference algorithms.


Learning Compact Representations of Neural Networks using DiscriminAtive Masking (DAM). A central goal in deep learning is to learn compact representations of features at every layer of a neural network, which is useful for both unsupervised representation learning and structured network pruning. While there is a growing body of work in structured pruning, current state of the art methods suffer from two key limitations (i) instability during training, and (ii) need for an additional step of fine tuning, which is resource intensive. At the core of these limitations is the lack of a systematic approach that jointly prunes and refines weights during training in a single stage, and does not require any fine tuning upon convergence to achieve state of the art performance. We present a novel single stage structured pruning method termed DiscriminAtive Masking (DAM). The key intuition behind DAM is to discriminatively prefer some of the neurons to be refined during the training process, while gradually masking out other neurons. We show that our proposed DAM approach has remarkably good performance over various applications, including dimensionality reduction, recommendation system, graph representation learning, and structured pruning for image classification. We also theoretically show that the learning objective of DAM is directly related to minimizing the L0 norm of the masking layer.


Quadratic Weyl group multiple Dirichlet series of Type D scriptscriptstyle 4 scriptscriptstyle (1) . In this paper and its sequel cite DPP , we investigate the precise relationship between the quadratic affine Weyl group multiple Dirichlet series in the sense of cite CG1, BD , and those defined axiomatically by Whitehead cite White2 and cite White1 . In particular, we show that the axiomatic quadratic Weyl group multiple Dirichlet series of type D scriptscriptstyle 4 scriptscriptstyle (1) over rational function fields of odd characteristic admits meromorphic continuation to the interior of the corresponding complexified Tits cone. We shall also determine the polar divisor of this function, and compute the residue at each of its poles. As a consequence, we obtain an emph exact formula for a weighted 4 th moment of quadratic Dirichlet L functions over rational function fields we shall also derive an asymptotic formula for this weighted moment that is expected to generalize to any global field.


Landscape Correspondence of Empirical and Population Risks in the Eigendecomposition Problem. Spectral methods include a family of algorithms related to the eigenvectors of certain data generated matrices. In this work, we are interested in studying the geometric landscape of the eigendecomposition problem in various spectral methods. In particular, we first extend known results regarding the landscape at critical points to larger regions near the critical points in a special case of finding the leading eigenvector of a symmetric matrix. For a more general eigendecomposition problem, inspired by recent findings on the connection between the landscapes of empirical risk and population risk, we then build a novel connection between the landscape of an eigendecomposition problem that uses random measurements and the one that uses the true data matrix. We also apply our theory to a variety of low rank matrix optimization problems and conduct a series of simulations to illustrate our theoretical findings.


A Survey of Community Detection Approaches From Statistical Modeling to Deep Learning. Community detection, a fundamental task for network analysis, aims to partition a network into multiple sub structures to help reveal their latent functions. Community detection has been extensively studied in and broadly applied to many real world network problems. Classical approaches to community detection typically utilize probabilistic graphical models and adopt a variety of prior knowledge to infer community structures. As the problems that network methods try to solve and the network data to be analyzed become increasingly more sophisticated, new approaches have also been proposed and developed, particularly those that utilize deep learning and convert networked data into low dimensional representation. Despite all the recent advancement, there is still a lack of insightful understanding of the theoretical and methodological underpinning of community detection, which will be critically important for future development of the area of network analysis. In this paper, we develop and present a unified architecture of network community finding methods to characterize the state of the art of the field of community detection. Specifically, we provide a comprehensive review of the existing community detection methods and introduce a new taxonomy that divides the existing methods into two categories, namely probabilistic graphical model and deep learning. We then discuss in detail the main idea behind each method in the two categories. Furthermore, to promote future development of community detection, we release several benchmark datasets from several problem domains and highlight their applications to various network analysis tasks. We conclude with discussions of the challenges of the field and suggestions of possible directions for future research.


Tunable Mie Resonances in the Visible Spectrum. Dielectric optical nanoantennas play an important role in color displays, metasurface holograms, and wavefront shaping applications. They usually exploit Mie resonances as supported on nanostructures with high refractive index, such as Si and TiO2. However, these resonances normally cannot be tuned. Although phase change materials, such as the germanium antimony tellurium alloys and post transition metal oxides, such as ITO, have been used to tune optical antennas in the near infrared spectrum, tunable dielectric antennae in the visible spectrum remain to be demonstrated. In this paper, we designed and experimentally demonstrated tunable dielectric nanoantenna arrays with Mie resonances in the visible spectrum, exploiting phase transitions in wide bandgap Sb2S3 nano resonators. In the amorphous state, Mie resonances in these Sb2S3 nanostructures give rise to a strong structural color in reflection mode. Thermal annealing induced crystallization and laser induced amorphization of the Sb2S3 resonators allow the color to be tuned reversibly. We believe these tunable Sb2S3 nanoantennae arrays will enable a wide variety of tunable nanophotonic applications, such as high resolution color displays, holographic displays, and miniature LiDAR systems.


Fuzzy clustering algorithms with distance metric learning and entropy regularization. The clustering methods have been used in a variety of fields such as image processing, data mining, pattern recognition, and statistical analysis. Generally, the clustering algorithms consider all variables equally relevant or not correlated for the clustering task. Nevertheless, in real situations, some variables can be correlated or may be more or less relevant or even irrelevant for this task. This paper proposes partitioning fuzzy clustering algorithms based on Euclidean, City block and Mahalanobis distances and entropy regularization. These methods are an iterative three steps algorithms which provide a fuzzy partition, a representative for each fuzzy cluster, and the relevance weight of the variables or their correlation by minimizing a suitable objective function. Several experiments on synthetic and real datasets, including its application to noisy image texture segmentation, demonstrate the usefulness of these adaptive clustering methods.


Cohomology of semisimple local systems and the Decomposition theorem. In this paper, we study the cohomology of semisimple local systems in the spirit of classical Hodge theory. On the one hand, we establish a generalization of Hodge Riemann bilinear relations. For a semisimple local system on a smooth projective variety, we define a canonical isomorphism from the complex conjugate of its cohomology to the cohomology of the dual local system, which is a generalization of the classical Weil operator for pure Hodge structures. This isomorphism establishes a relation between the twisted Poincar 'e pairing, a purely topological object, and a positive definite Hermitian pairing. On the other hand, we prove a global invariant cycle theorem for semisimple local systems. As an application, we give a new and geometric proof of Sabbah's Decomposition Theorem for the direct images of semisimple local systems under proper algebraic maps, without using the category of polarizable twistor D modules.


A multiresolution Discrete Element Method for triangulated objects with implicit timestepping. Simulations of many rigid bodies colliding with each other sometimes yield particularly interesting results if the colliding objects differ significantly in size and are non spherical. The most expensive part within such a simulation code is the collision detection. We propose a family of novel multiscale collision detection algorithms that can be applied to triangulated objects within explicit and implicit time stepping methods. They are well suited to handle objects that cannot be represented by analytical shapes or assemblies of analytical objects. Inspired by multigrid methods and adaptive mesh refinement, we determine collision points iteratively over a resolution hierarchy, and combine a functional minimisation plus penalty parameters with the actual comparision based geometric distance calculation. Coarse surrogate geometry representations identify "no collision" scenarios early on and otherwise yield an educated guess which triangle subsets of the next finer level potentially yield collisions. They prune the search tree, and furthermore feed conservative contact force estimates into the iterative solve behind an implicit time stepping. Implicit time stepping and non analytical shapes often yield prohibitive high compute cost for rigid body simulations. Our approach reduces these cost algorithmically by one to two orders of magnitude. It also exhibits high vectorisation efficiency due to its iterative nature.


Quasi phase matching with Spontaneous Domain Inversion in an Integrated Lithium Niobate Micro racetrack Resonator. Quasi phase matching (QPM) technology is the most popular and significant method to achieve efficient nonlinear frequency conversion. The realization of periodically poling to achieve QPM in photonic integrated circuits (PICs) is a challenging issue for the requirement of CMOS compatible and large scale fabrication. Here we realize a spontaneous periodical domain inversion without poling but by dispersion engineering and designing the orientation of the crystal due to the circular propagation of light waves in an integrated lithium niobate micro racetrack resonator (MRR). The QPM second harmonic generation (SHG) with a normalized conversion efficiency of 2.25 W (169th order QPM) has been achieved in the high quality factor resonator of sim 10 8 with the straight waveguide (TE 00 mode) of ultra low propagation loss of 0.0022dB cm. The efficiency can be further enhanced by using a first order QPM, and the bandwidth can be made broader by employing a shorter interaction length for photonics and quantum optics. The configurable spontaneous quasi phase matching lithium niobate MRR on X cut thin film lithium niobate on insulator (LNOI) provides a significant on chip integrated platform for other optical parametric processes.


Momentum scalar triple product as a measure of chirality in electron ionization dynamics of strongly driven atoms. We formulate a transparent measure that quantifies chirality in single electron ionization triggered in atoms, which are achiral systems. We do so in the context of Ar driven by a new type of optical fields that consists of two non collinear laser beams giving rise to chirality that varies in space across the focus of the beams. Our computations account for realistic experimental conditions. To define this measure of chirality, we first find the sign of the electron final momentum scalar triple product mathrm bf p k cdot ( bf p i times bf p j ) and multiply it with the probability for an electron to ionize with certain values for both mathrm p k and mathrm p i p j . Then, we integrate this product over all values of mathrm p k and mathrm p i p j . We show this to be a robust measure of chirality in electron ionization triggered by globally chiral electric fields.


Blunting an Adversary Against Randomized Concurrent Programs with Linearizable Implementations. Atomic shared objects, whose operations take place instantaneously, are a powerful abstraction for designing complex concurrent programs. Since they are not always available, they are typically substituted with software implementations. A prominent condition relating these implementations to their atomic specifications is linearizability, which preserves safety properties of the programs using them. However linearizability does not preserve hyper properties, which include probabilistic guarantees of randomized programs an adversary can greatly amplify the probability of a bad outcome. This unwelcome behavior prevents modular reasoning, which is the key benefit provided by the use of linearizable object implementations. A more restrictive property, strong linearizability, does preserve hyper properties but it is impossible to achieve in many situations. This paper suggests a novel approach to blunting the adversary's additional power that works even in cases where strong linearizability is not achievable. We show that a wide class of linearizable implementations, including well known ones for registers and snapshots, can be modified to approximate the probabilistic guarantees of randomized programs when using atomic objects. The technical approach is to transform the algorithm of each method of an existing linearizable implementation by repeating a carefully chosen prefix of the method several times and then randomly choosing which repetition to use subsequently. We prove that the probability of a bad outcome decreases with the number of repetitions, approaching the probability attained when using atomic objects. The class of implementations to which our transformation applies includes the ABD implementation of a shared register using message passing and the Afek et al. implementation of an atomic snapshot using single writer registers.


Intelligent interactive technologies for mental health and well being. Mental healthcare has seen numerous benefits from interactive technologies and artificial intelligence. Various interventions have successfully used intelligent technologies to automate the assessment and evaluation of psychological treatments and mental well being and functioning. These technologies include different types of robots, video games, and conversational agents. The paper critically analyzes existing solutions with the outlooks for their future. In particular, we i)give an overview of the technology for mental health, ii) critically analyze the technology against the proposed criteria, and iii) provide the design outlooks for these technologies.


Coarsening Optimization for Differentiable Programming. This paper presents a novel optimization for differentiable programming named coarsening optimization. It offers a systematic way to synergize symbolic differentiation and algorithmic differentiation (AD). Through it, the granularity of the computations differentiated by each step in AD can become much larger than a single operation, and hence lead to much reduced runtime computations and data allocations in AD. To circumvent the difficulties that control flow creates to symbolic differentiation in coarsening, this work introduces phi calculus, a novel method to allow symbolic reasoning and differentiation of computations that involve branches and loops. It further avoids "expression swell" in symbolic differentiation and balance reuse and coarsening through the design of reuse centric segment of interest identification. Experiments on a collection of real world applications show that coarsening optimization is effective in speeding up AD, producing several times to two orders of magnitude speedups.


Semi measures and their Fourier transform. The basic theory of semi measures on locally compact Abelian groups is extended to prove the existence of a generalised Eberlein decomposition into such semi measures.


TetraPackNet Four Corner Based Object Detection in Logistics Use Cases. While common image object detection tasks focus on bounding boxes or segmentation masks as object representations, we consider the problem of finding objects based on four arbitrary vertices. We propose a novel model, named TetraPackNet, to tackle this problem. TetraPackNet is based on CornerNet and uses similar algorithms and ideas. It is designated for applications requiring high accuracy detection of regularly shaped objects, which is the case in the logistics use case of packaging structure recognition. We evaluate our model on our specific real world dataset for this use case. Baselined against a previous solution, consisting of a Mask R CNN model and suitable post processing steps, TetraPackNet achieves superior results (9 higher in accuracy) in the sub task of four corner based transport unit side detection.


A Novel Iterative Soft Decision Decoding Algorithm for RS SPC Product Codes. This paper presents a generalized construction of RS SPC product codes. A low complexity joint decoding scheme is proposed for these codes, in which a BP based iterative decoding is performed based on the binary expansion of the whole parity check matrix. Various powerful RS codes can be used as the component codes for RS SPC product codes, which gives a good performance for local decoding (decode a single component codeword). The proposed BP based iterative decoding is a global decoding, and it achieves an error correcting capability comparable to codes of large blocklengths. This two phase decoding scheme preserves the low decoding latency and complexity of the local decoding while achieves high reliability through the global decoding. The complexity of the proposed iterative decoding is discussed, and the simulation results show the proposed scheme offers a good trade off between the complexity and the error performance.


Semi supervised Anatomical Landmark Detection via Shape regulated Self training. Well annotated medical images are costly and sometimes even impossible to acquire, hindering landmark detection accuracy to some extent. Semi supervised learning alleviates the reliance on large scale annotated data by exploiting the unlabeled data to understand the population structure of anatomical landmarks. The global shape constraint is the inherent property of anatomical landmarks that provides valuable guidance for more consistent pseudo labelling of the unlabeled data, which is ignored in the previously semi supervised methods. In this paper, we propose a model agnostic shape regulated self training framework for semi supervised landmark detection by fully considering the global shape constraint. Specifically, to ensure pseudo labels are reliable and consistent, a PCA based shape model adjusts pseudo labels and eliminate abnormal ones. A novel Region Attention loss to make the network automatically focus on the structure consistent regions around pseudo labels. Extensive experiments show that our approach outperforms other semi supervised methods and achieves notable improvement on three medical image datasets. Moreover, our framework is flexible and can be used as a plug and play module integrated into most supervised methods to improve performance further.


Cataloging Dependency Injection Anti Patterns in Software Systems. Context Dependency Injection (DI) is a commonly applied mechanism to decouple classes from their dependencies in order to provide higher modularization. However, bad DI practices often lead to negative consequences, such as increasing coupling. Although white literature conjectures about the existence of DI anti patterns, there is no evidence on their practical relevance, usefulness, and generality. Objective The objective of this study is to propose and evaluate a catalog of Java DI anti patterns and associated refactorings. Methodology We reviewed existing reported DI anti patterns in order to analyze their completeness. The limitations found in literature motivated proposing a novel catalog of 12 DI anti patterns. We developed a tool to statically analyze the occurrence level of the candidate DI anti patterns in both open source and industry projects. Next, we survey practitioners to assess their perception on the relevance, usefulness, and their willingness on refactoring anti pattern instances of the catalog. Results Our static code analyzer tool showed a relative recall of 92.19 and high average precision. It revealed that at least 9 different DI anti patterns appeared frequently in the analyzed projects. Besides, our survey confirmed the perceived relevance of the catalog and developers expressed their willingness to refactor instances of anti patterns from source code. Conclusion The catalog contains Java DI anti patterns that occur in practice and that are perceived as useful. Sharing it with practitioners may help them to avoid such anti patterns, thus improving source code quality.


Communication Efficient Federated Learning for Neural Machine Translation. Training neural machine translation (NMT) models in federated learning (FL) settings could be inefficient both computationally and communication wise, due to the large size of translation engines as well as the multiple rounds of updates required to train clients and a central server. In this paper, we explore how to efficiently build NMT models in an FL setup by proposing a novel solution. In order to reduce the communication overhead, out of all neural layers we only exchange what we term "Controller" layers. Controllers are a small number of additional neural components connected to our pre trained architectures. These new components are placed in between original layers. They act as liaisons to communicate with the central server and learn minimal information that is sufficient enough to update clients. We evaluated the performance of our models on five datasets from different domains to translate from German into English. We noted that the models equipped with Controllers preform on par with those trained in a central and non FL setting. In addition, we observed a substantial reduction in the communication traffic of the FL pipeline, which is a direct consequence of using Controllers. Based on our experiments, Controller based models are 6 times less expensive than their other peers. This reduction is significantly important when we consider the number of parameters in large models and it becomes even more critical when such parameters need to be exchanged for multiple rounds in FL settings.


Local Betweenness Centrality Analysis of 30 European Cities. Urban morphology and socioeconomic aspects of cities have been explored by analysing urban street network. To analyse the network, several variations of the centrality indices are often used. However, its nature has not yet been widely studied, thus leading to an absence of robust visualisation method of urban road network characteristics. To fill this gap, we propose to use a set of local betweenness centrality and a new simple and robust visualisation method. By analysing 30 European cities, we found that our method illustrates common structures of the cities road segments important for long distance transportations are concentrated along larger streets while those for short range transportations form clusters around CBD, historical, or residential districts. Quantitative analysis has corroborated these findings. Our findings are useful for urban planners and decision makers to understand the current situation of the city and make informed decisions.


Automatic image annotation base on Naive Bayes and Decision Tree classifiers using MPEG 7. Recently it has become essential to search for and retrieve high resolution and efficient images easily due to swift development of digital images, many present annotation algorithms facing a big challenge which is the variance for represent the image where high level represent image semantic and low level illustrate the features, this issue is known as semantic gab. This work has been used MPEG 7 standard to extract the features from the images, where the color feature was extracted by using Scalable Color Descriptor (SCD) and Color Layout Descriptor (CLD), whereas the texture feature was extracted by employing Edge Histogram Descriptor (EHD), the CLD produced high dimensionality feature vector therefore it is reduced by Principal Component Analysis (PCA). The features that have extracted by these three descriptors could be passing to the classifiers (Naive Bayes and Decision Tree) for training. Finally, they annotated the query image. In this study TUDarmstadt image bank had been used. The results of tests and comparative performance evaluation indicated better precision and executing time of Naive Bayes classification in comparison with Decision Tree classification.


Newton Polyhedra and Whitney Equisingularity for Isolated Determinantal Singularities. Using equivalence of matrices and Newton polyhedra, we compute the local Euler obstruction of isolated determinantal singularities and present a condition which guarantees the Whitney equisingularity of a family of isolated determinantal singularities.


Rethinking Why Intermediate Task Fine Tuning Works. Supplementary Training on Intermediate Labeled data Tasks (STILTs) is a widely applied technique, which first fine tunes the pretrained language models on an intermediate task before on the target task of interest. While STILTs is able to further improve the performance of pretrained language models, it is still unclear why and when it works. Previous research shows that those intermediate tasks involving complex inference, such as commonsense reasoning, work especially well for RoBERTa. In this paper, we discover that the improvement from an intermediate task could be orthogonal to it containing reasoning or other complex skills a simple real fake discrimination task synthesized by GPT2 can benefit diverse target tasks. We conduct extensive experiments to study the impact of different factors on STILTs. These findings suggest rethinking the role of intermediate fine tuning in the STILTs pipeline.


Parameter Differentiation based Multilingual Neural Machine Translation. Multilingual neural machine translation (MNMT) aims to translate multiple languages with a single model and has been proved successful thanks to effective knowledge transfer among different languages with shared parameters. However, it is still an open question which parameters should be shared and which ones need to be task specific. Currently, the common practice is to heuristically design or search language specific modules, which is difficult to find the optimal configuration. In this paper, we propose a novel parameter differentiation based method that allows the model to determine which parameters should be language specific during training. Inspired by cellular differentiation, each shared parameter in our method can dynamically differentiate into more specialized types. We further define the differentiation criterion as inter task gradient similarity. Therefore, parameters with conflicting inter task gradients are more likely to be language specific. Extensive experiments on multilingual datasets have demonstrated that our method significantly outperforms various strong baselines with different parameter sharing configurations. Further analyses reveal that the parameter sharing configuration obtained by our method correlates well with the linguistic proximities.


Modeling and Optimizing Laser Induced Graphene. A lot of technological advances depend on next generation materials, such as graphene, which enables a raft of new applications, for example better electronics. Manufacturing such materials is often difficult in particular, producing graphene at scale is an open problem. We provide a series of datasets that describe the optimization of the production of laser induced graphene, an established manufacturing method that has shown great promise. We pose three challenges based on the datasets we provide modeling the behavior of laser induced graphene production with respect to parameters of the production process, transferring models and knowledge between different precursor materials, and optimizing the outcome of the transformation over the space of possible production parameters. We present illustrative results, along with the code used to generate them, as a starting point for interested users. The data we provide represents an important real world application of machine learning to the best of our knowledge, no similar datasets are available.


MIT SafePaths Card (MiSaCa) Augmenting Paper Based Vaccination Cards with Printed Codes. In this early draft, we describe a user centric, card based system for vaccine distribution. Our system makes use of digitally signed QR codes and their use for phased vaccine distribution, vaccine administration record keeping, immunization verification, and follow up symptom reporting. Furthermore, we propose and describe a complementary scanner app system to be used by vaccination clinics, public health officials, and immunization verification parties to effectively utilize card based framework. We believe that the proposed system provides a privacy preserving and efficient framework for vaccine distribution in both developed and developing regions.


Mating of discrete trees and walks in the quarter plane. We give a general construction of triangulations starting from a walk in the quarter plane with small steps, which is a discrete version of the mating of trees. We use a special instance of this construction to give a bijection between maps equipped with a rooted spanning tree and walks in the quarter plane. We also show how the construction allows to recover several known bijections between such objects in a uniform way.


Fool Me Once Robust Selective Segmentation via Out of Distribution Detection with Contrastive Learning. In this work, we train a network to simultaneously perform segmentation and pixel wise Out of Distribution (OoD) detection, such that the segmentation of unknown regions of scenes can be rejected. This is made possible by leveraging an OoD dataset with a novel contrastive objective and data augmentation scheme. By combining data including unknown classes in the training data, a more robust feature representation can be learned with known classes represented distinctly from those unknown. When presented with unknown classes or conditions, many current approaches for segmentation frequently exhibit high confidence in their inaccurate segmentations and cannot be trusted in many operational environments. We validate our system on a real world dataset of unusual driving scenes, and show that by selectively segmenting scenes based on what is predicted as OoD, we can increase the segmentation accuracy by an IoU of 0.2 with respect to alternative techniques.


Toward a unified theory for the Hadley cell descending and ascending edges. We present theories for the latitudinal extents of both Hadley cells throughout the annual cycle by combining our recent scaling for the ascending edge latitude (Hill et al. 2021) with the uniform Rossby number (Ro), baroclinic instability based theory for the poleward, descending edge latitudes of Kang and Lu 2012. The resulting analytic expressions for all three Hadley cell edges are predictive except for diagnosed values of Ro and two proportionality constants. The theory captures the climatological annual cycle of the ascending and descending edges in an Earth like simulation in an idealized aquaplanet general circulation model (GCM), provided the descending edge prediction is lagged by one month. In simulations in this and two other idealized GCMs with varied planetary rotation rate ( Omega ), the winter, descending edge of the solsticial, cross equatorial Hadley cell scales approximately as Omega 1 2 and the summer, ascending edge as Omega 2 3 , both in accordance with our theory.


Trapping of Planar Brownian Motion Full First Passage Time Distributions by Kinetic Monte Carlo, Asymptotic and Boundary Integral Methods. We consider the problem of determining the arrival statistics of unbiased planar random walkers to complex target configurations. In contrast to problems posed in finite domains, simple moments of the distribution, such as the mean (MFPT) and variance, are not defined and it is necessary to obtain the full arrival statistics. We describe several methods to obtain these distributions and other associated quantities such as splitting probabilities. One approach combines a Laplace transform of the underlying parabolic equation with matched asymptotic analysis followed by numerical transform inversion. The second approach is similar, but uses a boundary integral equation method to solve for the Laplace transformed variable. To validate the results of this theory, and to obtain the arrival time statistics in very general configurations of absorbers, we introduce an efficient Kinetic Monte Carlo (KMC) method that describes trajectories as a combination of large but exactly solvable projection steps. The effectiveness of these methodologies is demonstrated on a variety of challenging examples highlighting the applicability of these methods to a variety of practical scenarios, such as source inference. A particularly useful finding arising from these results is that homogenization theories, in which complex configurations are replaced by equivalent simple ones, are remarkably effective at describing arrival time statistics.


Surrogate Model Based Hyperparameter Tuning for Deep Learning with SPOT. A surrogate model based hyperparameter tuning approach for deep learning is presented. This article demonstrates how the architecture level parameters (hyperparameters) of deep learning models that were implemented in Keras tensorflow can be optimized. The implementation of the tuning procedure is 100 accessible from R, the software environment for statistical computing. With a few lines of code, existing R packages (tfruns and SPOT) can be combined to perform hyperparameter tuning. An elementary hyperparameter tuning task (neural network and the MNIST data) is used to exemplify this approach


Existence, uniqueness, and convergence rates for gradient flows in the training of artificial neural networks with ReLU activation. The training of artificial neural networks (ANNs) with rectified linear unit (ReLU) activation via gradient descent (GD) type optimization schemes is nowadays a common industrially relevant procedure. Till this day in the scientific literature there is in general no mathematical convergence analysis which explains the numerical success of GD type optimization schemes in the training of ANNs with ReLU activation. GD type optimization schemes can be regarded as temporal discretization methods for the gradient flow (GF) differential equations associated to the considered optimization problem and, in view of this, it seems to be a natural direction of research to first aim to develop a mathematical convergence theory for time continuous GF differential equations and, thereafter, to aim to extend such a time continuous convergence theory to implementable time discrete GD type optimization methods. In this article we establish two basic results for GF differential equations in the training of fully connected feedforward ANNs with one hidden layer and ReLU activation. In the first main result of this article we establish in the training of such ANNs under the assumption that the probability distribution of the input data of the considered supervised learning problem is absolutely continuous with a bounded density function that every GF differential equation admits for every initial value a solution which is also unique among a suitable class of solutions. In the second main result of this article we prove in the training of such ANNs under the assumption that the target function and the density function of the probability distribution of the input data are piecewise polynomial that every non divergent GF trajectory converges with an appropriate rate of convergence to a critical point and that the risk of the non divergent GF trajectory converges with rate 1 to the risk of the critical point.


Solving Viewing Graph Optimization for Simultaneous Position and Rotation Registration. A viewing graph is a set of unknown camera poses, as the vertices, and the observed relative motions, as the edges. Solving the viewing graph is an essential step in a Structure from Motion procedure, where a set of relative motions is obtained from a collection of 2D images. Almost all methods in the literature solve for the rotations separately, through rotation averaging process, and use them for solving the positions. Obtaining positions is the challenging part because the translation observations only tell the direction of the motions. It becomes more challenging when the set of edges comprises pairwise translation observations between either near and far cameras. In this paper an iterative method is proposed that overcomes these issues. Also a method is proposed which obtains the rotations and positions simultaneously. Experimental results show the state of the art performance of the proposed methods.


The limit empirical spectral distribution of complex matrix polynomials. We study the empirical spectral distribution (ESD) for complex n x n matrix polynomials of degree k. We obtain exact formulae for the almost sure limit of the ESD in two distinct scenarios (1) n infty with k constant and (2) k infty with n bounded by O(k P) for some P 0. The main tools used are the logarithmic potential of some measure related to the matrix polynomial, and some classical estimates on the singular values of full random matrices with i.i.d. entries.


Contrastive Representation Learning for Exemplar Guided Paraphrase Generation. Exemplar Guided Paraphrase Generation (EGPG) aims to generate a target sentence which conforms to the style of the given exemplar while encapsulating the content information of the source sentence. In this paper, we propose a new method with the goal of learning a better representation of the style andthe content. This method is mainly motivated by the recent success of contrastive learning which has demonstrated its power in unsupervised feature extraction tasks. The idea is to design two contrastive losses with respect to the content and the style by considering two problem characteristics during training. One characteristic is that the target sentence shares the same content with the source sentence, and the second characteristic is that the target sentence shares the same style with the exemplar. These two contrastive losses are incorporated into the general encoder decoder paradigm. Experiments on two datasets, namely QQP Pos and ParaNMT, demonstrate the effectiveness of our proposed constrastive losses.


Global well posedness and regularity of 3D Burgers equation with multiplicative noise. In this paper, we develop low regularity theory for 3D Burgers equation perturbed by a linear multiplicative stochastic force. This method is new and essentially different from the deterministic partial differential equations(PDEs). Our results and method can be widely applied to other stochastic hydrodynamic equations and the deterministic PDEs. As a further study, we establish a random version of maximum principle for random 3D Burgers equations, which will be an important tool for the study of 3D stochastic Burgers equations. As we know establishing moment estimates for highly nonlinear stochastic hydrodynamic equations is difficult. But moment estimates are very important for us to study the probabilistic properties and long time behavior for the stochastic systems. Here, the random maximum principle helps us to achieve some important moment estimates for 3D stochastic Burgers equations and lays a solid foundation for the further study of 3D stochastic Burgers equations.


Edge Deletion to Restrict the Size of an Epidemic. Given a graph G (V,E) , a set mathcal F of forbidden subgraphs, we study mathcal F Free Edge Deletion, where the goal is to remove minimum number of edges such that the resulting graph does not contain any F in mathcal F as a subgraph. For the parameter treewidth, the question of whether the problem is FPT has remained open. Here we give a negative answer by showing that the problem is W 1 hard when parameterized by the treewidth, which rules out FPT algorithms under common assumption. Thus we give a solution to the conjecture posted by Jessica Enright and Kitty Meeks in Algorithmica 80 (2018) 1857 1889 . We also prove that the mathcal F Free Edge Deletion problem is W 2 hard when parameterized by the solution size k , feedback vertex set number or pathwidth of the input graph. A special case of particular interest is the situation in which mathcal F is the set mathcal T h 1 of all trees on h 1 vertices, so that we delete edges in order to obtain a graph in which every component contains at most h vertices. This is desirable from the point of view of restricting the spread of disease in transmission network. We prove that the mathcal T h 1 Free Edge Deletion problem is fixed parameter tractable (FPT) when parameterized by the vertex cover number. We also prove that it admits a kernel with O(hk) vertices and O(h 2k) edges, when parameterized by combined parameters h and the solution size k .


Trees in transformers a theoretical analysis of the Transformer's ability to represent trees. Transformer networks are the de facto standard architecture in natural language processing. To date, there are no theoretical analyses of the Transformer's ability to capture tree structures. We focus on the ability of Transformer networks to learn tree structures that are important for tree transduction problems. We first analyze the theoretical capability of the standard Transformer architecture to learn tree structures given enumeration of all possible tree backbones, which we define as trees without labels. We then prove that two linear layers with ReLU activation function can recover any tree backbone from any two nonzero, linearly independent starting backbones. This implies that a Transformer can learn tree structures well in theory. We conduct experiments with synthetic data and find that the standard Transformer achieves similar accuracy compared to a Transformer where tree position information is explicitly encoded, albeit with slower convergence. This confirms empirically that Transformers can learn tree structures.


Blow up of nonnegative solutions of an abstract semilinear heat equation with convex source. We give a sufficient condition for non existence of global nonnegative mild solutions of the Cauchy problem for the semilinear heat equation u' Lu f(u) in L p(X,m) for p in 1, infty) , where (X,m) is a sigma finite measure space, L is the infinitesimal generator of a sub Markovian strongly continuous semigroup of bounded linear operators in L p(X,m) , and f is a strictly increasing, convex, continuous function on 0, infty) with f(0) 0 and int 1 infty 1 f infty . Since we make no further assumptions on the behaviour of the diffusion, our main result can be seen as being about the competition between the diffusion represented by L and the reaction represented by f in a general setting. We apply our result to Laplacians on manifolds, graphs, and, more generally, metric measure spaces with a heat kernel. In the process, we recover and extend some older as well as recent results in a unified framework.


Global Convergence of Algorithms Under Constant Rank Conditions for Nonlinear Second Order Cone Programming. In R. Andreani, G. Haeser, L. M. Mito, H. Ram 'irez C., Weak notions of nondegeneracy in nonlinear semidefinite programming, arXiv 2012.14810, 2020 the classical notion of nondegeneracy (or transversality) and Robinson's constraint qualification have been revisited in the context of nonlinear semidefinite programming exploiting the structure of the problem, namely, its eigendecomposition. This allows formulating the conditions equivalently in terms of (positive) linear independence of significantly smaller sets of vectors. In this paper we extend these ideas to the context of nonlinear second order cone programming. For instance, for an m dimensional second order cone, instead of stating nondegeneracy at the vertex as the linear independence of m derivative vectors, we do it in terms of several statements of linear independence of 2 derivative vectors. This allows embedding the structure of the second order cone into the formulation of nondegeneracy and, by extension, Robinson's constraint qualification as well. This point of view is shown to be crucial in defining significantly weaker constraint qualifications such as the constant rank constraint qualification and the constant positive linear dependence condition. Also, these conditions are shown to be sufficient for guaranteeing global convergence of several algorithms, while still implying metric subregularity and without requiring boundedness of the set of Lagrange multipliers.


Extending the Time Horizon Efficient Public Transit Routing on Arbitrary Length Timetables. We study the problem of computing all Pareto optimal journeys in a public transit network regarding the two criteria of arrival time and number of transfers taken. In recent years, great advances have been made in making public transit network routing more scalable to larger networks. However, most approaches are silent on scalability in another dimension Time. Experimental evaluations are often done on slices of timetables spanning a couple of days, when in reality, the planning horizon is much longer. We introduce an extension to trip based public transit routing, proposed in 12 , that allows efficient handling of arbitrarily long timetables. Our experimental evaluation shows that the resulting algorithm achieves fast queries on year spanning timetables, and can incorporate updates such as delays or changed routes quickly even on large networks.


Towards Communication Efficient and Privacy Preserving Federated Representation Learning. This paper investigates the feasibility of federated representation learning under the constraints of communication cost and privacy protection. Existing works either conduct annotation guided local training which requires frequent communication or aggregates the client models via weight averaging which has potential risks of privacy exposure. To tackle the above problems, we first identify that self supervised contrastive local training is robust against the non identically distributed data, which provides the feasibility of longer local training and thus reduces the communication cost. Then based on the aforementioned robustness, we propose a novel Federated representation Learning framework with Ensemble Similarity Distillation (FLESD) that utilizes this robustness. At each round of communication, the server first gathers a fraction of the clients' inferred similarity matrices on a public dataset. Then it ensembles the similarity matrices and train the global model via similarity distillation. We verify the effectiveness of FLESD by a series of empirical experiments and show that, despite stricter constraints, it achieves comparable results under multiple settings on multiple datasets.


Lyra A Benchmark for Turducken Style Code Generation. Code generation is crucial to reduce manual software development efforts. Recently, neural techniques have been used to generate source code automatically. While promising, these approaches are evaluated on tasks for generating code in single programming languages. However, in actual development, one programming language is often embedded in another. For example, SQL statements are often embedded as strings in base programming languages such as Python and Java, and JavaScript programs are often embedded in sever side programming languages, such as PHP, Java, and Python. We call this a turducken style programming. In this paper, we define a new code generation task given a natural language comment, this task aims to generate a program in a base language with an embedded language. To our knowledge, this is the first turducken style code generation task. For this task, we present Lyra a dataset in Python with embedded SQL. This dataset contains 2,000 carefully annotated database manipulation programs from real usage projects. Each program is paired with both a Chinese comment and an English comment. In our experiment, we adopted Transformer, a state of the art technique, as the baseline. In the best setting, Transformer achieves 0.5 and 1.5 AST exact matching accuracy using Chinese and English comments, respectively. Therefore, we believe that Lyra provides a new challenge for code generation.


Unveiling personnel movement in a larger indoor area with a non overlapping multi camera system. Surveillance cameras are widely applied for indoor occupancy measurement and human movement perception, which benefit for building energy management and social security. To address the challenges of limited view angle of single camera as well as lacking of inter camera collaboration, this study presents a non overlapping multi camera system to enlarge the surveillance area and devotes to retrieve the same person appeared from different camera views. The system is deployed in an office building and four day videos are collected. By training a deep convolutional neural network, the proposed system first extracts the appearance feature embeddings of each personal image, which detected from different cameras, for similarity comparison. Then, a stochastic inter camera transition matrix is associated with appearance feature for further improving the person re identification ranking results. Finally, a noise suppression explanation is given for analyzing the matching improvements. This paper expands the scope of indoor movement perception based on non overlapping multiple cameras and improves the accuracy of pedestrian re identification without introducing additional types of sensors.


Enhancing the Analysis of Software Failures in Cloud Computing Systems with Deep Learning. Identifying the failure modes of cloud computing systems is a difficult and time consuming task, due to the growing complexity of such systems, and the large volume and noisiness of failure data. This paper presents a novel approach for analyzing failure data from cloud systems, in order to relieve human analysts from manually fine tuning the data for feature engineering. The approach leverages Deep Embedded Clustering (DEC), a family of unsupervised clustering algorithms based on deep learning, which uses an autoencoder to optimize data dimensionality and inter cluster variance. We applied the approach in the context of the OpenStack cloud computing platform, both on the raw failure data and in combination with an anomaly detection pre processing algorithm. The results show that the performance of the proposed approach, in terms of purity of clusters, is comparable to, or in some cases even better than manually fine tuned clustering, thus avoiding the need for deep domain knowledge and reducing the effort to perform the analysis. In all cases, the proposed approach provides better performance than unsupervised clustering when no feature engineering is applied to the data. Moreover, the distribution of failure modes from the proposed approach is closer to the actual frequency of the failure modes.


Every non smooth 2 dimensional Banach space has the Mazur Ulam property. A Banach space X has the Mazur Ulam property if any isometry from the unit sphere of X onto the unit sphere of any other Banach space Y extends to a linear isometry of the Banach spaces X,Y . A Banach space X is called smooth if the unit ball has a unique supporting functional at each point of the unit sphere. We prove that each non smooth 2 dimensional Banach space has the Mazur Ulam property.


Mitsumatsu's Liouville domains are stably Weinstein. We develop explicit local operations that may be applied to Liouville domains, with the goal of simplifying the dynamics of the Liouville vector field. These local operations, which are Liouville homotopies, are inspired by the techniques used by Honda and Huang in HH19 to show that convex hypersurfaces are C 0 generic in contact manifolds. As an application, we use our operations to show that Mitsumatsu's well known Liouville but not Weinstein domains are stably Weinstein, answering a question asked by Huang in Hua20 .


Model Based Derivative Free Methods for Convex Constrained Optimization. We present a model based derivative free method for optimization subject to general convex constraints, which we assume are unrelaxable and accessed only through a projection operator that is cheap to evaluate. We prove global convergence and a worst case complexity of O( epsilon 2 ) iterations and objective evaluations for nonconvex functions, matching results for the unconstrained case. We introduce new, weaker requirements on model accuracy compared to existing methods. As a result, sufficiently accurate interpolation models can be constructed only using feasible points. We develop a comprehensive theory of interpolation set management in this regime for linear and composite linear models. We implement our approach for nonlinear least squares problems and demonstrate strong practical performance compared to general purpose solvers.


FirmwareDroid Security Analysis of the Android Firmware EcoSystem. The Android Open Source Project (AOSP) is probably the most used and customized operating system for smartphones and IoT devices worldwide. Its market share and high adaptability makes Android an interesting operating system for many developers. Nowadays, we use Android firmware in smartphones, TVs, smartwatches, cars, and other devices by various vendors and manufacturers. The sheer amount of customized Android firmware and devices makes it hard for security analysts to detect potentially harmful applications. Another fact is that many vendors include apps from 3rd party developers. Such bloatware usually has more privileges than standard apps and cannot be removed by the user without rooting the device. In recent years several cases were reported where 3rd party developers could include malicious apps into the Android built chain. Media reports claim that pre installed malware like Chamois and Triade we able to infect several million devices. Such cases demonstrate the need for better strategies for analyzing Android firmware. In our study, we analyze the Android firmware eco system in various ways. We collected a dataset with several thousand Android firmware archives and show that several terabytes of firmware data are waiting on the web to be analyzed. We develop a web service called FirmwareDroid for analyzing Android firmware archives and pre installed apps and create a dataset of firmware samples. Focusing on Android apps, we automated the process of extracting and scanning pre installed apps with state of the art open source tools. We demonstrate on real data that pre installed apps are, in fact, a a threat to Android's users, and we can detect several hundred malware samples using scanners like VirusTotal, AndroGuard, and APKiD. With state of the art tools, we could scan more than 900000 apps during our research and give unique insights into Android custom ROMs.


Making decisions in the dark basement of the brain A look back at the GPR model of action selection and the basal ganglia. How does your brain decide what you will do next? Over the past few decades compelling evidence has emerged that the basal ganglia, a collection of nuclei in the fore and mid brain of all vertebrates, are vital to action selection. Gurney, Prescott, and Redgrave published an influential computational account of this idea in Biological Cybernetics in 2001. Here we take a look back at this pair of papers, outlining the "GPR" model contained therein, the context of that model's development, and the influence it has had over the past twenty years. Tracing its lineage into models and theories still emerging now, we are encouraged that the GPR model is that rare thing, a computational model of a brain circuit whose advances were directly built on by others.


Tumor Spheroid Chemotaxis in Epidermal Growth Factor Gradients Revealed by a 3D Microfluidic Device. Epidermal growth factor (EGF), a potent cytokine, is known to promote tumor invasion both in vivo and in vitro. Previously, we observed that single breast tumor cells (MDA MB 231 cell line) embedded within a 3D collagen matrix displayed enhanced motility but no discernible chemotaxis in the presence of linear EGF gradients using a microfluidic platform. Inspired by a recent theoretical development that clustered mammalian cells respond differently to chemical gradients than single cells, we studied tumor spheroid invasion within a 3D extracellular matrix (ECM) in the presence of EGF gradients. We found that EGF gradients promoted tumor cell detachment from the spheroid core, and the position of the tumor spheroid core showed a mild chemotactic response towards the EGF gradients. For those tumor cells detached from the spheroids, they showed an enhanced chemokinesis response in contrast to previous experimental results using single cells embedded within an ECM. No discernible chemotactic response towards the EGF gradients was found for the cells outside the spheroid core. This work demonstrates that a cluster of tumor cells responds differently than single tumor cells towards EGF gradients and highlights the importance of a tumor spheroid platform for chemotaxis studies.


Document Level Text Simplification Dataset, Criteria and Baseline. Text simplification is a valuable technique. However, current research is limited to sentence simplification. In this paper, we define and investigate a new task of document level text simplification, which aims to simplify a document consisting of multiple sentences. Based on Wikipedia dumps, we first construct a large scale dataset named D Wikipedia and perform analysis and human evaluation on it to show that the dataset is reliable. Then, we propose a new automatic evaluation metric called D SARI that is more suitable for the document level simplification task. Finally, we select several representative models as baseline models for this task and perform automatic evaluation and human evaluation. We analyze the results and point out the shortcomings of the baseline models.


Lightweight Selective Disclosure for Verifiable Documents on Blockchain. To achieve lightweight selective disclosure for protecting privacy of document holders, we propose an XML format for documents that can hide arbitrary elements using a cryptographic hash function and salts, which allows to be partially digitally signed and efficiently verified, as well as a JSON format that can be converted to such XML. The documents can be efficiently proven to exist by representing multiple such structures as a Merkle tree and storing its root in blockchain. We show that our proposal has advantages over known methods that represent the document itself as a Merkle tree and partially hide it.


Neural Options Pricing. This research investigates pricing financial options based on the traditional martingale theory of arbitrage pricing applied to neural SDEs. We treat neural SDEs as universal It o process approximators. In this way we can lift all assumptions on the form of the underlying price process, and compute theoretical option prices numerically. We propose a variation of the SDE GAN approach by implementing the Wasserstein distance metric as a loss function for training. Furthermore, it is conjectured that the error of the option price implied by the learnt model can be bounded by the very Wasserstein distance metric that was used to fit the empirical data.


Predicting Issue Types on GitHub. Software maintenance and evolution involves critical activities for the success of software projects. To support such activities and keep code up to date and error free, software communities make use of issue trackers, i.e., tools for signaling, handling, and addressing the issues occurring in software systems. However, in popular projects, tens or hundreds of issue reports are daily submitted. In this context, identifying the type of each submitted report (e.g., bug report, feature request, etc.) would facilitate the management and the prioritization of the issues to address. To support issue handling activities, in this paper, we propose Ticket Tagger, a GitHub app analyzing the issue title and description through machine learning techniques to automatically recognize the types of reports submitted on GitHub and assign labels to each issue accordingly. We empirically evaluated the tool's prediction performance on about 30,000 GitHub issues. Our results show that the Ticket Tagger can identify the correct labels to assign to GitHub issues with reasonably high effectiveness. Considering these results and the fact that the tool is designed to be easily integrated in the GitHub issue management process, Ticket Tagger consists in a useful solution for developers.