Self driven nanofluidics at liquid gas interface. We report novel flow dynamics at the interface of liquid and gas through nanofluidic pores without applying any external driving force. Rayleigh Taylor instability of water and air in sub 100 nanometer fluidic pores in a micrometre square domain of water and air are studied. We analyse it in the context of parameters, such as applied pressure, position to pore size ratio of the nanofluidic pore, gravity, and density. The paper also verifies the flow velocity equation with the simulation results and discuss the mass transfer efficiency of such flow structures. We are the first to report a self driven switching mechanism of nanofluidic flow from ON to OFF or vice versa. A highly nonlinear complex nature of fluid dynamics is observed in nanometric length scale, which is also one of the first studies in room temperature. Self driven nanofluidics will have a large positive impact on healthcare, net zero sustainable energy production, and fundamental physics of fluid dynamics.


Local, global and scale dependent node roles. This paper re examines the concept of node equivalences like structural equivalence or automorphic equivalence, which have originally emerged in social network analysis to characterize the role an actor plays within a social system, but have since then been of independent interest for graph based learning tasks. Traditionally, such exact node equivalences have been defined either in terms of the one hop neighborhood of a node, or in terms of the global graph structure. Here we formalize exact node roles with a scale parameter, describing up to what distance the ego network of a node should be considered when assigning node roles motivated by the idea that there can be local roles of a node that should not be determined by nodes arbitrarily far away in the network. We present numerical experiments that show how already "shallow" roles of depth 3 or 4 carry sufficient information to perform node classification tasks with high accuracy. These findings corroborate the success of recent graph learning approaches that compute approximate node roles in terms of embeddings, by nonlinearly aggregating node features in an (un)supervised manner over relatively small neighborhood sizes. Indeed, based on our ideas we can construct a shallow classifier achieving on par results with recent graph neural network architectures.


An overlapping waveform relaxation preconditioner for economic optimal control problems with state constraints. In this work, a class of parabolic economic optimal control problems is considered. These problems are characterized by pointwise state constraints regularized by a parameter, which transforms the pure state constraints in mixed control state ones. However, the convergence of classical (semismooth) Newton methods deteriorates for decreasing values of the regularization parameter. To tackle this problem, a nonlinear preconditioner is introduced. This is based on an overlapping optimized waveform relaxation method characterized by Robin transmission conditions. Numerical experiments show that appropriate choices of the overlap and of the Robin parameter lead to a preconditioned Newton method with a robust convergence against the state constraints regularization parameter.


Decomposition of flow data via gradient based transport optimization. We study an optimization problem related to the approximation of given data by a linear combination of transformed modes. In the simplest case, the optimization problem reduces to a minimization problem well studied in the context of proper orthogonal decomposition. Allowing transformed modes in the approximation renders this approach particularly useful to compress data with transported quantities, which are prevalent in many flow applications. We prove the existence of a solution to the infinite dimensional optimization problem. Towards a numerical implementation, we compute the gradient of the cost functional and derive a suitable discretization in time and space. We demonstrate the theoretical findings with three challenging numerical examples.


Designing Air Flow with Surrogate assisted Phenotypic Niching. In complex, expensive optimization domains we often narrowly focus on finding high performing solutions, instead of expanding our understanding of the domain itself. But what if we could quickly understand the complex behaviors that can emerge in said domains instead? We introduce surrogate assisted phenotypic niching, a quality diversity algorithm which allows to discover a large, diverse set of behaviors by using computationally expensive phenotypic features. In this work we discover the types of air flow in a 2D fluid dynamics optimization problem. A fast GPU based fluid dynamics solver is used in conjunction with surrogate models to accurately predict fluid characteristics from the shapes that produce the air flow. We show that these features can be modeled in a data driven way while sampling to improve performance, rather than explicitly sampling to improve feature models. Our method can reduce the need to run an infeasibly large set of simulations while still being able to design a large diversity of air flows and the shapes that cause them. Discovering diversity of behaviors helps engineers to better understand expensive domains and their solutions.


New infrared spectra of CO2 Xe modeling Xe isotope effects, intermolecular bend and stretch, and symmetry breaking of the CO2 bend. The infrared spectrum of the weakly bound CO2 Xe complex is studied in the region of the carbon dioxide nu3 fundamental vibration ( 2350 cm 1), using a tunable OPO laser source to probe a pulsed supersonic slit jet expansion. The Xe isotope dependence of the spectrum is modeled by scaling the vibrational and rotational parameters, with the help of previous microwave data. The scaling model provides a good simulation of the observed broadening and (partial) splitting of transitions in the fundamental band, and it is essential for understanding the intermolecular bending combination band where some transitions are completely split by isotope effects. The combination band is influenced by a significant bend stretch Coriolis interaction and by the relatively large Xe isotope dependence of the intermolecular stretch frequency. The weak CO2 Xe spectrum corresponding to the (0111) (0110) hot band of CO2 is also detected and analyzed, providing a measurement of the symmetry breaking of the CO2 bending mode induced by the nearby Xe atom. This in plane out of plane splitting is determined to be 2.14 cm 1.


On the Pitfalls of Analyzing Individual Neurons in Language Models. While many studies have shown that linguistic information is encoded in hidden word representations, few have studied individual neurons, to show how and in which neurons it is encoded. Among these, the common approach is to use an external probe to rank neurons according to their relevance to some linguistic attribute, and to evaluate the obtained ranking using the same probe that produced it. We show two pitfalls in this methodology 1. It confounds distinct factors probe quality and ranking quality. We separate them and draw conclusions on each. 2. It focuses on encoded information, rather than information that is used by the model. We show that these are not the same. We compare two recent ranking methods and a simple one we introduce, and evaluate them with regard to both of these aspects.


Blockchain Based Federated Learning in Mobile Edge Networks with Application in Internet of Vehicles. The rapid increase of the data scale in Internet of Vehicles (IoV) system paradigm, hews out new possibilities in boosting the service quality for the emerging applications through data sharing. Nevertheless, privacy concerns are major bottlenecks for data providers to share private data in traditional IoV networks. To this end, federated learning (FL) as an emerging learning paradigm, where data providers only send local model updates trained on their local raw data rather than upload any raw data, has been recently proposed to build a privacy preserving data sharing models. Unfortunately, by analyzing on the differences of uploaded local model updates from data providers, private information can still be divulged, and performance of the system cannot be guaranteed when partial federated nodes executes malicious behavior. Additionally, traditional cloud based FL poses challenges to the communication overhead with the rapid increase of terminal equipment in IoV system. All these issues inspire us to propose an autonomous blockchain empowered privacy preserving FL framework in this paper, where the mobile edge computing (MEC) technology was naturally integrated in IoV system.


The Co Moving Velocity in Immiscible Two Phase Flow in Porous Media. We present a continuum (i.e., an effective) description of immiscible two phase flow in porous media characterized by two fields, the pressure and the saturation. Gradients in these two fields are the driving forces that move the immiscible fluids around. The fluids are characterized by two seepage velocity fields, one for each fluid. Following Hansen et al. (Transport in Porous Media, 125, 565 (2018)), we construct a two way transformation between the velocity couple consisting of the seepage velocity of each fluid, to a velocity couple consisting of the average seepage velocity of both fluids and a new velocity parameter, the co moving velocity. The co moving velocity is related but not equal to velocity difference between the two immiscible fluids. The two way mapping, the mass conservation equation and the constitutive equations for the average seepage velocity and the co moving velocity form a closed set of equations that determine the flow. There is growing experimental, computational and theoretical evidence that constitutive equation for the average seepage velocity has the form of a power law in the pressure gradient over a wide range of capillary numbers. Through the transformation between the two velocity couples, this constitutive equation may be taken directly into account in the equations describing the flow of each fluid. This is e.g., not possible using relative permeability theory. By reverse engineering relative permeability data from the literature, we construct the constitutive equation for the co moving velocity. We also calculate the co moving constitutive equation using a dynamic pore network model over a wide range of parameters, from where the flow is viscosity dominated to where the capillary and viscous forces compete.


Uniquely orderable interval graphs. Interval graphs and interval orders are deeply linked. In fact, edges of an interval graphs represent the incomparability relation of an interval order, and in general, of different interval orders. The question about the conditions under which a given interval graph is associated to a unique interval order (up to duality) arises naturally. Fishburn provided a characterisation for uniquely orderable finite connected interval graphs. We show, by an entirely new proof, that the same characterisation holds also for infinite connected interval graphs. Using tools from reverse mathematics, we explain why the characterisation cannot be lifted from the finite to the infinite by compactness, as it often happens.


Representation Formula for Viscosity Solutions to a class of Nonlinear Parabolic PDEs. We provide a representation formula for viscosity solutions to a class of nonlinear second order parabolic PDEs given as a sup envelope function. This is done through a dynamic programming principle derived from Denis, Hu, Peng (2010). The formula can be seen as a nonlinear extension of the Feynman Kac formula and is based on the backward stochastic differential equations theory.


Emergence of Hopf bifurcation in an extended SIR dynamic. In this paper, the SIR dynamics is extended by considering another compartmental which represents hospitalization of the critical cases. So a system of differential equations with four blocks is considered when there is intensive care unit (ICU) to cure critical cases. Outgoing rate of survived infected individuals is divided into nI and frac bI I b . The second term represents the rate of critical cases who enter ICUs. It is proved that there are forward, backward and Hopf bifurcations in different regimes of parameters.


On the effective version of Serre's open image theorem. Let E mathbb Q be an elliptic curve without complex multiplication. By Serre's open image theorem, the mod ell Galois representation of E is surjective for each prime number ell that is sufficiently large. Under GRH, we give an upper bound on the largest non surjective prime, in terms of the conductor of E , that makes effective a bound of the same asymptotic quality due to Larson Vaintrob.


Virtual elements on agglomerated finite elements to increase the critical time step in elastodynamic simulations. In this paper, we use the first order virtual element method (VEM) to investigate the effect of shape quality of polyhedra in the estimation of the critical time step for explicit three dimensional elastodynamic finite element simulations. Low quality finite elements are common when meshing realistic complex components, and while tetrahedral meshing technology is generally robust, meshing algorithms cannot guarantee high quality meshes for arbitrary geometries or for non water tight computer aided design models. For reliable simulations on such meshes, we consider finite element meshes with tetrahedral and prismatic elements that have badly shaped elements tetrahedra with dihedral angles close to 0 circ and 180 circ , and slender prisms with triangular faces that have short edges and agglomerate such bad' elements with neighboring elements to form a larger polyhedral virtual element. On each element of the mesh, the element eigenvalue inequality is used to obtain an estimate of the critical time step. For a suite of illustrative finite element meshes with epsilon being a mesh coordinate parameter that leads to poor mesh quality, we show that adopting VEM on the agglomerated polyhedra yield critical time steps that are insensitive as epsilon rightarrow 0 . This study shows the promise of virtual element technology for reliable explicit finite element elastodynamic simulations on low quality three dimensional meshes.


Hypers at ComMA ICON Modelling Aggressiveness, Gender Bias and Communal Bias Identification. Due to the exponentially increasing reach of social media, it is essential to focus on its negative aspects as it can potentially divide society and incite people into violence. In this paper, we present our system description of work on the shared task ComMA ICON, where we have to classify how aggressive the sentence is and if the sentence is gender biased or communal biased. These three could be the primary reasons to cause significant problems in society. As team Hypers we have proposed an approach that utilizes different pretrained models with Attention and mean pooling methods. We were able to get Rank 3 with 0.223 Instance F1 score on Bengali, Rank 2 with 0.322 Instance F1 score on Multi lingual set, Rank 4 with 0.129 Instance F1 score on Meitei and Rank 5 with 0.336 Instance F1 score on Hindi. The source code and the pretrained models of this work can be found here.


PSI A Pedestrian Behavior Dataset for Socially Intelligent Autonomous Car. Prediction of pedestrian behavior is critical for fully autonomous vehicles to drive in busy city streets safely and efficiently. The future autonomous cars need to fit into mixed conditions with not only technical but also social capabilities. As more algorithms and datasets have been developed to predict pedestrian behaviors, these efforts lack the benchmark labels and the capability to estimate the temporal dynamic intent changes of the pedestrians, provide explanations of the interaction scenes, and support algorithms with social intelligence. This paper proposes and shares another benchmark dataset called the IUPUI CSRC Pedestrian Situated Intent (PSI) data with two innovative labels besides comprehensive computer vision labels. The first novel label is the dynamic intent changes for the pedestrians to cross in front of the ego vehicle, achieved from 24 drivers with diverse backgrounds. The second one is the text based explanations of the driver reasoning process when estimating pedestrian intents and predicting their behaviors during the interaction period. These innovative labels can enable several computer vision tasks, including pedestrian intent behavior prediction, vehicle pedestrian interaction segmentation, and video to language mapping for explainable algorithms. The released dataset can fundamentally improve the development of pedestrian behavior prediction models and develop socially intelligent autonomous cars to interact with pedestrians efficiently. The dataset has been evaluated with different tasks and is released to the public to access.


Quantitative mapping of the brain's structural connectivity using diffusion MRI tractography a review. Diffusion magnetic resonance imaging (dMRI) tractography is an advanced imaging technique that enables in vivo mapping of the brain's white matter connections at macro scale. Over the last two decades, the study of brain connectivity using dMRI tractography has played a prominent role in the neuroimaging research landscape. In this paper, we provide a high level overview of how tractography is used to enable quantitative analysis of the brain's structural connectivity in health and disease. We first provide a review of methodology involved in three main processing steps that are common across most approaches for quantitative analysis of tractography, including methods for tractography correction, segmentation and quantification. For each step, we aim to describe methodological choices, their popularity, and potential pros and cons. We then review studies that have used quantitative tractography approaches to study the brain's white matter, focusing on applications in neurodevelopment, aging, neurological disorders, mental disorders, and neurosurgery. We conclude that, while there have been considerable advancements in methodological technologies and breadth of applications, there nevertheless remains no consensus about the "best" methodology in quantitative analysis of tractography, and researchers should remain cautious when interpreting results in research and clinical applications.


Demonstration of negative refraction induced by synthetic gauge fields. The phenomenon of negative refraction generally requires negative refractive indices or phase discontinuities, which can be realized using metamaterials or metasurfaces. Recent theories have proposed a novel mechanism for negative refraction based on synthetic gauge fields, which affect classical waves as if they were charged particles in electromagnetic fields, but this has not hitherto been demonstrated in experiment. Here, we report on the experimental demonstration of gauge field induced negative refraction in a twisted bilayer acoustic metamaterial. The bilayer twisting produces a synthetic gauge field for sound waves propagating within a projected two dimensional geometry, with the magnitude of the gauge field parameterized by the choice of wavenumber along the third dimension. Waveguiding with backward propagating modes is also demonstrated in a trilayer configuration that implements strong gauge fields. These results provide an alternative route to achieving negative refraction in synthetic materials.


Mask combine Decoding and Classification Approach for Punctuation Prediction with real time Inference Constraints. In this work, we unify several existing decoding strategies for punctuation prediction in one framework and introduce a novel strategy which utilises multiple predictions at each word across different windows. We show that significant improvements can be achieved by optimising these strategies after training a model, only leading to a potential increase in inference time, with no requirement for retraining. We further use our decoding strategy framework for the first comparison of tagging and classification approaches for punctuation prediction in a real time setting. Our results show that a classification approach for punctuation prediction can be beneficial when little or no right side context is available.


Communication With Adversary Identification in Byzantine Multiple Access Channels. We introduce the problem of determining the identity of a byzantine user (internal adversary) in a communication system. We consider a two user discrete memoryless multiple access channel where either user may deviate from the prescribed behaviour. Owing to the noisy nature of the channel, it may be overly restrictive to attempt to detect all deviations. In our formulation, we only require detecting deviations which impede the decoding of the non deviating user's message. When neither user deviates, correct decoding is required. When one user deviates, the decoder must either output a pair of messages of which the message of the non deviating user is correct or identify the deviating user. The users and the receiver do not share any randomness. The results include a characterization of the set of channels where communication is feasible, and an inner and outer bound on the capacity region.


On a solution to the Basel problem based on the fundamental theorem of calculus. We give a proof of the identity zeta(2) sum n 1 infty frac 1 n 2 frac pi 2 6 using the fundamental theorem of calculus and differentiation under the integral sign.


Towards Unsupervised Dense Information Retrieval with Contrastive Learning. Information retrieval is an important component in natural language processing, for knowledge intensive tasks such as question answering and fact checking. Recently, information retrieval has seen the emergence of dense retrievers, based on neural networks, as an alternative to classical sparse methods based on term frequency. These models have obtained state of the art results on datasets and tasks where large training sets are available. However, they do not transfer well to new domains or applications with no training data, and are often outperformed by term frequency methods such as BM25 which are not supervised. Thus, a natural question is whether it is possible to train dense retrievers without supervision. In this work, we explore the limits of contrastive learning as a way to train unsupervised dense retrievers, and show that it leads to strong retrieval performance. More precisely, we show on the BEIR benchmark that our model outperforms BM25 on 11 out of 15 datasets. Furthermore, when a few thousands examples are available, we show that fine tuning our model on these leads to strong improvements compared to BM25. Finally, when used as pre training before fine tuning on the MS MARCO dataset, our technique obtains state of the art results on the BEIR benchmark.


Complete Agent driven Model based System Testing for Autonomous Systems. In this position paper, a novel approach to testing complex autonomous transportation systems (ATS) in the automotive, avionic, and railway domains is described. It is intended to mitigate some of the most critical problems regarding verification and validation (V V) effort for ATS. V V is known to become infeasible for complex ATS, when using conventional methods only. The approach advocated here uses complete testing methods on the module level, because these establish formal proofs for the logical correctness of the software. Having established logical correctness, system level tests are performed in simulated cloud environments and on the target system. To give evidence that 'sufficiently many' system tests have been performed with the target system, a formally justified coverage criterion is introduced. To optimise the execution of very large system test suites, we advocate an online testing approach where multiple tests are executed in parallel, and test steps are identified on the fly. The coordination and optimisation of these executions is achieved by an agent based approach. Each aspect of the testing approach advocated here is shown to either be consistent with existing standards for development and V V of safety critical transportation systems, or it is justified why it should become acceptable in future revisions of the applicable standards.


Locally Private k Means in One Round. We provide an approximation algorithm for k means clustering in the one round (aka non interactive) local model of differential privacy (DP). This algorithm achieves an approximation ratio arbitrarily close to the best non private approximation algorithm, improving upon previously known algorithms that only guarantee large (constant) approximation ratios. Furthermore, this is the first constant factor approximation algorithm for k means that requires only one round of communication in the local DP model, positively resolving an open question of Stemmer (SODA 2020). Our algorithmic framework is quite flexible we demonstrate this by showing that it also yields a similar near optimal approximation algorithm in the (one round) shuffle DP model.


Boosting of Head Pose Estimation by Knowledge Distillation. We propose a response based method of knowledge distillation (KD) for the head pose estimation problem. A student model trained by the proposed KD achieves results better than a teacher model, which is atypical for the response based method. Our method consists of two stages. In the first stage, we trained the base neural network (NN), which has one regression head and four regression via classification (RvC) heads. We build the convolutional ensemble over the base NN using offsets of face bounding boxes over a regular grid. In the second stage, we perform KD from the convolutional ensemble into the final NN with one RvC head. The KD improves the results by an average of 7.7 compared to base NN. This feature makes it possible to use KD as a booster and effectively train deeper NNs. NNs trained by our KD method partially improved the state of the art results. KD ResNet152 has the best results, and KD ResNet18 has a better result on the AFLW2000 dataset than any previous method.We have made publicly available trained NNs and face bounding boxes for the 300W LP, AFLW, AFLW2000, and BIWI datasets.Our method potentially can be effective for other regression problems.


Fibration structure for Gromov h principle. The h principle is a powerful tool for obtaining solutions to partial differential inequalities and partial differential equations. Gromov discovered the h principle for the general partial differential relations to generalize the results of Hirsch and Smale. In his book, Gromov generalizes his theorem and discusses the sheaf theoretic h principle, in which an object called a flexible sheaf plays an important role. We show that a flexible sheaf can be interpreted as a fibrant object with respect to a model structure.


Positive and negative extensions in extriangulated categories. We initiate the study of derived functors in the setting of extriangulated categories. By using coends, we adapt Yoneda's theory of higher extensions to this framework. We show that, when there are enough projectives or enough injectives, thus defined extensions agree with the ones defined earlier via projective or injective resolutions. For categories with enough projective or enough injective morphisms, we prove that these are right derived functors of the operatorname Hom bifunctor in either argument. Since operatorname Hom is only half exact in each argument, it is natural to expect "negative extensions", i.e. its left derived functors, to exist and not necessarily vanish. We define negative extensions with respect to the first and to the second argument and show that they give rise to universal delta functors, when there are enough projective or injective morphisms, respectively. In general, they are not balanced. However, for topological extriangulated categories, the existence of a balanced version of negative extensions follows from combining the work of Klemenc on exact infty categories with results of the second and third authors. We discuss various criteria under which one has the balance of the above bifunctors on the functorial or on the numerical levels. This happens, in particular, in the cases of exact or triangulated categories, and also in the case of the category of n term complexes with projective components over a finite dimensional algebra. Given a connected sequence of functors on an extriangulated category ( mathcal C , mathbb E , mathfrak s ) , we determine the maximal relative extriangulated structure, with respect to which the sequence is a delta functor. We also find several equivalent criteria for the existence of enough projective or injective morphisms in a given extriangulated category.


Homological mirror symmetry for nodal stacky curves. In this paper, we generalise the results of Lekili and Polishchuk arXiv 1705.06023 to establish homological mirror symmetry for Deligne Mumford stacks whose coarse moduli spaces are rings or chains of rational curves joined nodally, and where each irreducible component is allowed to have a generic stabiliser. The mirrors are mathbb Z graded open Riemann surfaces. As an application, we prove the Lekili Ueda conjecture for invertible polynomials in the case of curves where the grading group on the B side is allowed to be non maximal.


The Mirror Clemens Schmid Sequence. We introduce a four term long exact sequence that relates the cohomology of a smooth variety admitting a projective fibration over a projective base to the cohomology of the open set obtained by removing the preimage of a general linear section. We show that this sequence respects the perverse Leray filtration and induces exact sequences of mixed Hodge structures on its graded pieces. We conjecture that this exact sequence should be thought of as mirror to the Clemens Schmid sequence, which describes the cohomology of degenerations, and we exhibit this mirror relationship explicitly for all Type II and many Type III degenerations of K3 surfaces.


Universal Weil module. The classical construction of the Weil representation, that is with complex coefficients, has been expected to be working for more general coefficient rings. This paper exhibits a minimal ring mathcal A , being the integral closure of mathbb Z frac 1 p in a cyclotomic field, and carries the construction of the Weil representation over mathcal A algebras. As a leitmotiv all along the work, most of the problems can actually be solved over the based ring mathcal A and transferred for any mathcal A algebra by scalar extension. The most striking fact consists in these many Weil representations arising as the scalar extension of a single one with coefficients in mathcal A . In this sense, the Weil module obtained is universal. Building upon this construction, we are speculating and making prognoses about an integral theta correspondence.


Revisiting Point Cloud Simplification A Learnable Feature Preserving Approach. The recent advances in 3D sensing technology have made possible the capture of point clouds in significantly high resolution. However, increased detail usually comes at the expense of high storage, as well as computational costs in terms of processing and visualization operations. Mesh and Point Cloud simplification methods aim to reduce the complexity of 3D models while retaining visual quality and relevant salient features. Traditional simplification techniques usually rely on solving a time consuming optimization problem, hence they are impractical for large scale datasets. In an attempt to alleviate this computational burden, we propose a fast point cloud simplification method by learning to sample salient points. The proposed method relies on a graph neural network architecture trained to select an arbitrary, user defined, number of points from the input space and to re arrange their positions so as to minimize the visual perception error. The approach is extensively evaluated on various datasets using several perceptual metrics. Importantly, our method is able to generalize to out of distribution shapes, hence demonstrating zero shot capabilities.


Scissor cross ionization injection in laser wakefield accelerators. We propose to use a frequency doubled pulse colliding with the driving pulse at an acute angle to trigger ionization injection in a laser wakefield accelerator. This scheme effectively reduces the duration that injection occurs, thus high injection quality is obtained. Three dimensional particle in cell simulations show that electron beams with energy of 500 MeV, charge of 40 pC, energy spread of 1 and normalized emittance of a few millimeter milliradian can be produced by 100 TW laser pulses. By adjusting the angle between the two pulses, the intensity of the trigger pulse and the gas dope ratio, the charge and energy spread of the electron beam can be controlled.


Composable Generative Models. Generative modeling has recently seen many exciting developments with the advent of deep generative architectures such as Variational Auto Encoders (VAE) or Generative Adversarial Networks (GAN). The ability to draw synthetic i.i.d. observations with the same joint probability distribution as a given dataset has a wide range of applications including representation learning, compression or imputation. It appears that it also has many applications in privacy preserving data analysis, especially when used in conjunction with differential privacy techniques. This paper focuses on synthetic data generation models with privacy preserving applications in mind. It introduces a novel architecture, the Composable Generative Model (CGM) that is state of the art in tabular data generation. Any conditional generative model can be used as a sub component of the CGM, including CGMs themselves, allowing the generation of numerical, categorical data as well as images, text, or time series. The CGM has been evaluated on 13 datasets (6 standard datasets and 7 simulated) and compared to 14 recent generative models. It beats the state of the art in tabular data generation by a significant margin.


Paraphrasing via Ranking Many Candidates. We present a simple and effective way to generate a variety of paraphrases and find a good quality paraphrase among them. As in previous studies, it is difficult to ensure that one generation method always generates the best paraphrase in various domains. Therefore, we focus on finding the best candidate from multiple candidates, rather than assuming that there is only one combination of generative models and decoding options. Our approach shows that it is easy to apply in various domains and has sufficiently good performance compared to previous methods. In addition, our approach can be used for data augmentation that extends the downstream corpus, showing that it can help improve performance in English and Korean datasets.


Variations on the Tait Kneser theorem. The Tait Kneser theorem, first demonstrated by Peter G. Tait in 1896, states that the osculating circles along a plane curve with monotone non vanishing curvature are pairwise disjoint and nested. This note contains a proof of this theorem using the Lorentzian geometry of the space of circles. We show how a similar proof applies to two variations on the theorem, concerning the osculating Hooke and Kepler conics along a plane curve. We also prove a version of the 4 vertex theorem for Kepler conics.


Visualizing Music Genres using a Topic Model. Music Genres serve as an important meta data in the field of music information retrieval and have been widely used for music classification and analysis tasks. Visualizing these music genres can thus be helpful for music exploration, archival and recommendation. Probabilistic topic models have been very successful in modelling text documents. In this work, we visualize music genres using a probabilistic topic model. Unlike text documents, audio is continuous and needs to be sliced into smaller segments. We use simple MFCC features of these segments as musical words. We apply the topic model on the corpus and subsequently use the genre annotations of the data to interpret and visualize the latent space.


Perturbing ordinary differential equations to generate resonant and repeated root solutions. In the study of ordinary differential equations (ODEs) of the form hat L y(x) f(x) , where hat L is a linear differential operator, two related phenomena can arise resonance, where f(x) propto u(x) and hat L u(x) 0 , and repeated roots, where f(x) 0 and hat L hat D n for n geq 2 . We illustrate a method to generate exact solutions to these problems by taking a known homogeneous solution u(x) , introducing a parameter epsilon such that u(x) rightarrow u(x epsilon) , and Taylor expanding u(x epsilon) about epsilon 0 . The coefficients of this expansion frac partial k u partial epsilon k big epsilon 0 yield the desired resonant or repeated root solutions to the ODE. This approach, whenever it can be applied, is more insightful and less tedious than standard methods such as reduction of order or variation of parameters. While the ideas can be introduced at the undergraduate level, we could not find any elementary or advanced text that illustrates these ideas with appropriate generality.


Intelligent Conversational Android ERICA Applied to Attentive Listening and Job Interview. Following the success of spoken dialogue systems (SDS) in smartphone assistants and smart speakers, a number of communicative robots are developed and commercialized. Compared with the conventional SDSs designed as a human machine interface, interaction with robots is expected to be in a closer manner to talking to a human because of the anthropomorphism and physical presence. The goal or task of dialogue may not be information retrieval, but the conversation itself. In order to realize human level "long and deep" conversation, we have developed an intelligent conversational android ERICA. We set up several social interaction tasks for ERICA, including attentive listening, job interview, and speed dating. To allow for spontaneous, incremental multiple utterances, a robust turn taking model is implemented based on TRP (transition relevance place) prediction, and a variety of backchannels are generated based on time frame wise prediction instead of IPU based prediction. We have realized an open domain attentive listening system with partial repeats and elaborating questions on focus words as well as assessment responses. It has been evaluated with 40 senior people, engaged in conversation of 5 7 minutes without a conversation breakdown. It was also compared against the WOZ setting. We have also realized a job interview system with a set of base questions followed by dynamic generation of elaborating questions. It has also been evaluated with student subjects, showing promising results.


On the determinization of event clock input driven pushdown automata. Input driven pushdown automata (also known as visibly pushdown automata and as nested word automata) are a subclass of deterministic pushdown automata and a superclass of the parenthesis languages. Nguyen and Ogawa ("Event clock visibly pushdown automata", SOFSEM 2009) defined a timed extension of these automata under the event clock model, and showed that this model can be determinized using the method of region construction. This paper defines a further extension of this model with the event clock on the call return operations, and proposes a new, direct determinization procedure for these automata an n state nondeterministic automaton with k different clock constraints is transformed to a deterministic automaton with 2 n 2 states, 2 n 2 k stack symbols and the same clock constraints as in the original automaton. The construction is shown to be asymptotically optimal with respect to both the number of states and the number of stack symbols.


Overview of ADoBo 2021 Automatic Detection of Unassimilated Borrowings in the Spanish Press. This paper summarizes the main findings of the ADoBo 2021 shared task, proposed in the context of IberLef 2021. In this task, we invited participants to detect lexical borrowings (coming mostly from English) in Spanish newswire texts. This task was framed as a sequence classification problem using BIO encoding. We provided participants with an annotated corpus of lexical borrowings which we split into training, development and test splits. We received submissions from 4 teams with 9 different system runs overall. The results, which range from F1 scores of 37 to 85, suggest that this is a challenging task, especially when out of domain or OOV words are considered, and that traditional methods informed with lexicographic information would benefit from taking advantage of current NLP trends.


New Bregman proximal type algorithms for solving DC optimization problems. Difference of Convex (DC) optimization problems have objective functions that are differences between two convex functions. Representative ways of solving these problems are the proximal DC algorithms, which require that the convex part of the objective function have L smoothness. In this article, we propose the Bregman Proximal DC Algorithm (BPDCA) for solving large scale DC optimization problems that do not possess L smoothness. Instead, it requires that the convex part of the objective function has the L smooth adaptable property that is exploited in Bregman proximal gradient algorithms. In addition, we propose an accelerated version, the Bregman Proximal DC Algorithm with extrapolation (BPDCAe), with a new restart scheme. We show the global convergence of the iterates generated by BPDCA(e) to a critical point under the assumption of the Kurdyka L ojasiewicz property or subanalyticity of the objective function and other weaker conditions than those of the existing methods. We applied our algorithms to phase retrieval, which can be described as both a nonconvex optimization problem and as a DC optimization problem. Numerical experiments showed that BPDCAe outperformed existing Bregman proximal type algorithms because the DC formulation allows for larger admissible step sizes.


MOD Net A Machine Learning Approach via Model Operator Data Network for Solving PDEs. In this paper, we propose a a machine learning approach via model operator data network (MOD Net) for solving PDEs. A MOD Net is driven by a model to solve PDEs based on operator representation with regularization from data. For linear PDEs, we use a DNN to parameterize the Green's function and obtain the neural operator to approximate the solution according to the Green's method. To train the DNN, the empirical risk consists of the mean squared loss with the least square formulation or the variational formulation of the governing equation and boundary conditions. For complicated problems, the empirical risk also includes a few labels, which are computed on coarse grid points with cheap computation cost and significantly improves the model accuracy. Intuitively, the labeled dataset works as a regularization in addition to the model constraints. The MOD Net solves a family of PDEs rather than a specific one and is much more efficient than original neural operator because few expensive labels are required. We numerically show MOD Net is very efficient in solving Poisson equation and one dimensional radiative transfer equation. For nonlinear PDEs, the nonlinear MOD Net can be similarly used as an ansatz for solving nonlinear PDEs, exemplified by solving several nonlinear PDE problems, such as the Burgers equation.


Towards Principled Disentanglement for Domain Generalization. A fundamental challenge for machine learning models is generalizing to out of distribution (OOD) data, in part due to spurious correlations. To tackle this challenge, we first formalize the OOD generalization problem as constrained optimization, called Disentanglement constrained Domain Generalization (DDG). We relax this non trivial constrained optimization problem to a tractable form with finite dimensional parameterization and empirical approximation. Then a theoretical analysis of the extent to which the above transformations deviates from the original problem is provided. Based on the transformation, we propose a primal dual algorithm for joint representation disentanglement and domain generalization. In contrast to traditional approaches based on domain adversarial training and domain labels, DDG jointly learns semantic and variation encoders for disentanglement, enabling flexible manipulation and augmentation on training data. DDG aims to learn intrinsic representations of semantic concepts that are invariant to nuisance factors and generalizable across domains. Comprehensive experiments on popular benchmarks show that DDG can achieve competitive OOD performance and uncover interpretable salient structures within data.


Offline Reinforcement Learning as One Big Sequence Modeling Problem. Reinforcement learning (RL) is typically concerned with estimating stationary policies or single step models, leveraging the Markov property to factorize problems in time. However, we can also view RL as a generic sequence modeling problem, with the goal being to produce a sequence of actions that leads to a sequence of high rewards. Viewed in this way, it is tempting to consider whether high capacity sequence prediction models that work well in other domains, such as natural language processing, can also provide effective solutions to the RL problem. To this end, we explore how RL can be tackled with the tools of sequence modeling, using a Transformer architecture to model distributions over trajectories and repurposing beam search as a planning algorithm. Framing RL as sequence modeling problem simplifies a range of design decisions, allowing us to dispense with many of the components common in offline RL algorithms. We demonstrate the flexibility of this approach across long horizon dynamics prediction, imitation learning, goal conditioned RL, and offline RL. Further, we show that this approach can be combined with existing model free algorithms to yield a state of the art planner in sparse reward, long horizon tasks.


Anomaly Based Intrusion Detection by Machine Learning A Case Study on Probing Attacks to an Institutional Network. Cyber attacks constitute a significant threat to organizations with implications ranging from economic, reputational, and legal consequences. As cybercriminals' techniques get sophisticated, information security professionals face a more significant challenge to protecting information systems. In today's interconnected realm of computer systems, each attack vector has a network dimension. The present study investigates network intrusion attempts with anomaly based machine learning models to provide better protection than the conventional misuse based models. Two models, namely an ensemble learning model and a convolutional neural network model, were built and implemented on a data set gathered from a real life, institutional production environment. To demonstrate the models' reliability and validity, they were applied to the UNSW NB15 benchmarking data set. The type of attack was limited to probing attacks to keep the scope of the study manageable. The findings revealed high accuracy rates, the CNN model being slightly more accurate.


Homological mirror symmetry for elliptic Hopf surfaces. We show homological mirror symmetry results relating coherent analytic sheaves on some complex elliptic surfaces and objects of certain Fukaya categories. We first define the notion of a non algebraic Landau Ginzburg model on mathbb R times S 1 and its associated Fukaya category, and show that non K " a hler sur faces obtained by performing two logarithmic transformations to the product of the projective plane and an elliptic curve have non algebraic Landau Ginzburg models as their mirror spaces this class of surface includes the classical Hopf surface S 1 times S 3 and other elliptic primary and secondary Hopf surfaces. We also define localization maps from the Fukaya categories associated to the Landau Ginzburg models to partially wrapped and fully wrapped categories. We show mirror symmetry results that relate the partially wrapped and fully wrapped categories to spaces of coherent analytic sheaves on open submanifolds of the compact complex surfaces in question, and we use these results to sketch a proof of a full HMS result.


Framed combinatorial topology. Framed combinatorial topology is a novel theory describing combinatorial phenomena arising at the intersection of stratified topology, singularity theory, and higher algebra. The theory synthesizes elements of classical combinatorial topology with a new combinatorial approach to framings. The resulting notion of framed combinatorial spaces has unexpectedly good behavior when compared to classical, nonframed combinatorial notions of space. In discussing this behavior and its contrast with that of classical structures, we emphasize two broad themes, computability in combinatorial topology and combinatorializability of topological phenomena. The first theme of computability concerns whether certain combinatorial structures can be algorithmically recognized and classified. The second theme of combinatorializability concerns whether certain topological structures can be faithfully represented by a discrete structure. Combining these themes, we will find that in the context of framed combinatorial topology we can overcome a set of fundamental classical obstructions to the computable combinatorial representation of topological phenomena.


Nonreciprocity in Photon Pair Correlations. Nonreciprocal optical systems have found many applications altering the linear transmission of light as a function of its propagation direction. Here we consider a new class of nonreciprocity which appears in photon pair correlations and not in linear transmission. We experimentally demonstrate and theoretically verify this nonreciprocity in the second order coherence functions of photon pairs produced by spontaneous four wave mixing in a silicon microdisk. Reversal of the pump propagation direction can result in substantial extinction of the coherence functions without altering pump transmission.


BlockReduce Scaling Proof of Work Blockchains. This paper introduces BlockReduce, a Proof of Work (PoW) based blockchain system which achieves high transaction throughput through a hierarchy of merged mined blockchains, each operating in parallel on a partition the overall application state. Most notably, the full PoW available within the network is applied to all blockchains in BlockReduce, and cross blockchain state transitions are enabled seamlessly within the core protocol. This paper shows that, given a hierarchy of blockchains and its associated security model, the protocol scales superlinearly in transaction throughput with the number of blockchains operated by the protocol.


Central values of zeta functions of non Galois cubic fields. The Dedekind zeta functions of infinitely many non Galois cubic fields have negative central values.


BMO embeddings, chord arc curves, and Riemann mapping parametrization. We consider the space of chord arc curves on the plane passing through the infinity with their parametrization gamma on the real line, and embed this space into the product of the BMO Teichm "uller spaces. The fundamental theorem we prove about this representation is that log gamma' also gives a biholomorphic homeomorphism into the complex Banach space of BMO functions. Using these two equivalent complex structures, we develop a clear exposition on the analytic dependence of involved mappings between certain subspaces. Especially, we examine the parametrization of a chord arc curve by using the Riemann mapping and its dependence on the arc length parametrization. As a consequence, we can solve a conjecture of Katznelson, Nag, and Sullivan in 1990 by showing that this dependence is not continuous.


HASI Hardware Accelerated Stochastic Inference, A Defense Against Adversarial Machine Learning Attacks. Deep Neural Networks (DNNs) are employed in an increasing number of applications, some of which are safety critical. Unfortunately, DNNs are known to be vulnerable to so called adversarial attacks that manipulate inputs to cause incorrect results that can be beneficial to an attacker or damaging to the victim. Multiple defenses have been proposed to increase the robustness of DNNs. In general, these defenses have high overhead, some require attack specific re training of the model or careful tuning to adapt to different attacks. This paper presents HASI, a hardware accelerated defense that uses a process we call stochastic inference to detect adversarial inputs. We show that by carefully injecting noise into the model at inference time, we can differentiate adversarial inputs from benign ones. HASI uses the output distribution characteristics of noisy inference compared to a non noisy reference to detect adversarial inputs. We show an adversarial detection rate of 86 when applied to VGG16 and 93 when applied to ResNet50, which exceeds the detection rate of the state of the art approaches, with a much lower overhead. We demonstrate two software hardware accelerated co designs, which reduces the performance impact of stochastic inference to 1.58X 2X relative to the unprotected baseline, compared to 15X 20X overhead for a software only GPU implementation.


OCT GAN Neural ODE based Conditional Tabular GANs. Synthesizing tabular data is attracting much attention these days for various purposes. With sophisticate synthetic data, for instance, one can augment its training data. For the past couple of years, tabular data synthesis techniques have been greatly improved. Recent work made progress to address many problems in synthesizing tabular data, such as the imbalanced distribution and multimodality problems. However, the data utility of state of the art methods is not satisfactory yet. In this work, we significantly improve the utility by designing our generator and discriminator based on neural ordinary differential equations (NODEs). After showing that NODEs have theoretically preferred characteristics for generating tabular data, we introduce our designs. The NODE based discriminator performs a hidden vector evolution trajectory based classification rather than classifying with a hidden vector at the last layer only. Our generator also adopts an ODE layer at the very beginning of its architecture to transform its initial input vector (i.e., the concatenation of a noisy vector and a condition vector in our case) onto another latent vector space suitable for the generation process. We conduct experiments with 13 datasets, including but not limited to insurance fraud detection, online news article prediction, and so on, and our presented method outperforms other state of the art tabular data synthesis methods in many cases of our classification, regression, and clustering experiments.


Recurrent multiple shared layers in Depth for Neural Machine Translation. Learning deeper models is usually a simple and effective approach to improve model performance, but deeper models have larger model parameters and are more difficult to train. To get a deeper model, simply stacking more layers of the model seems to work well, but previous works have claimed that it cannot benefit the model. We propose to train a deeper model with recurrent mechanism, which loops the encoder and decoder blocks of Transformer in the depth direction. To address the increasing of model parameters, we choose to share parameters in different recursive moments. We conduct our experiments on WMT16 English to German and WMT14 English to France translation tasks, our model outperforms the shallow Transformer Base Big baseline by 0.35, 1.45 BLEU points, which is 27.23 of Transformer Big model parameters. Compared to the deep Transformer(20 layer encoder, 6 layer decoder), our model has similar model performance and infer speed, but our model parameters are 54.72 of the former.


Emotimonitor A Trello Power Up to Capture Emotions of Agile Teams. In recent years, Agile methods have continued to grow into a popular means of modulating team productivity, even garnering a presence in non software development related industries. The uptake of Agile methods has been driven by their flexibility, making them more suitable for many teams when compared to traditional approaches. However, an inevitable expectation for an Agile workflow is a higher level of change and uncertainty regarding requirements and tasks, which can ultimately have impacts on team member emotional states. The extent of such emotion impacts has motivated our research into the manner in which emotional states evolve in an Agile setting, along with whether such emotions can be accurately measured. To this end, we have developed Emotimonitor, a Trello power up designed to capture information on emotions of team members as they relate to their technical tasks through a user friendly interface. Emotimonitor will better enable team members to express their emotional states through emoji reactions on Trello cards, while also providing team leaders with a dashboard summarising these reactions as visualisations and statistical data. It is extensible and potentially provides an outlet for team members operating in Agile environments to better express their emotional states.


Poisson boundary on full Fock space. This article is devoted to studying the non commutative Poisson boundary associated with Big(B big( mathcal F ( mathcal H ) big), P omega Big) where mathcal H is a separable Hilbert space (finite or infinite dimensional), dim mathcal H 1 , with an orthonormal basis mathcal E , B big( mathcal F ( mathcal H ) big) is the algebra of bounded linear operators on the full Fock space mathcal F ( mathcal H ) defined over mathcal H , omega omega e e in mathcal E is a sequence of positive real numbers such that sum e omega e 1 and P omega is the Markov operator on B big( mathcal F ( mathcal H ) big) defined by begin align P omega (x) sum e in mathcal E omega e l e x l e, x in B big( mathcal F ( mathcal H ) big), end align where, for e in mathcal E , l e denotes the left creation operator associated with e . The non commutative Poisson boundary associated with Big(B big( mathcal F ( mathcal H ) big), P omega Big) turns out to be an injective factor of type III for any choice of omega . Moreover, if mathcal H is finite dimensional, we completely classify the Poisson boundary in terms of its Connes S invarinat and curiously they are type III lambda factors with lambda belonging to a certain small class of algebraic numbers.


On the dual of a P algebra and its comodules, with applications to comparison of some Bousfield classes. In his seminal work on localisation of spectra, Ravenel initiated the study of Bousfield classes of spectra related to the chromatic perspective. In particular he showed that there were infinitely many distinct Bousfield classes between langle MU rangle and langle S 0 rangle . The main topological goal of this paper is investigate how these Bousfield classes are related to that of another classical Thom spectrum MSp , and in particular how langle MSp rangle is related to langle MU rangle . We follow the approach of Ravenel, but adapt it using the theory of P algebras to give vanishing results for cohomology. Our work involves dualising and considering comodules over duals of P algebras these ideas are then applied to the mod 2 Steenrod algebra and certain subHopf algebras.


Superexponential Dehn functions inside CAT(0) groups. We construct 4 dimensional CAT(0) groups containing finitely presented subgroups whose Dehn functions are exp (n) (x m) for integers n, m geq 1 and 6 dimensional CAT(0) groups containing finitely presented subgroups whose Dehn functions are exp (n) (x alpha) for integers n geq 1 and alpha dense in 1, infty) . This significantly expands the known geometric behavior of subgroups of CAT(0) groups.


Periodic Floer homology and the smooth closing lemma for area preserving surface diffeomorphisms. We prove that a generic area preserving diffeomorphism of a closed surface has a dense set of periodic points. To do this, we prove a non vanishing result about Periodic Floer Homology, and then a very general version of a kind of Weyl law, originally conjectured by Hutchings. This Weyl law relates the asymptotics of the action of any twisted Periodic Floer Homology classes, over any coefficient ring, and the Calabi invariant of Hamiltonians. These results are potentially of independent interest. The application to generic density then follows by a variant of an argument by Irie, that used different spectral invariants to prove the analogous result for Reeb flows.


On Critical Kirchhoff problems driven by the fractional Laplacian. We study a nonlocal parametric problem driven by the fractional Laplacian operator combined with a Kirchhoff type coefficient and involving a critical nonlinearity term in the sense of Sobolev embeddings. Our approach is of variational and topological nature. The obtained results can be viewed as a nontrivial extension to the nonlocal setting of some recent contributions already present in the literature.


Edge Representation Learning with Hypergraphs. Graph neural networks have recently achieved remarkable success in representing graph structured data, with rapid progress in both the node embedding and graph pooling methods. Yet, they mostly focus on capturing information from the nodes considering their connectivity, and not much work has been done in representing the edges, which are essential components of a graph. However, for tasks such as graph reconstruction and generation, as well as graph classification tasks for which the edges are important for discrimination, accurately representing edges of a given graph is crucial to the success of the graph representation learning. To this end, we propose a novel edge representation learning framework based on Dual Hypergraph Transformation (DHT), which transforms the edges of a graph into the nodes of a hypergraph. This dual hypergraph construction allows us to apply message passing techniques for node representations to edges. After obtaining edge representations from the hypergraphs, we then cluster or drop edges to obtain holistic graph level edge representations. We validate our edge representation learning method with hypergraphs on diverse graph datasets for graph representation and generation performance, on which our method largely outperforms existing graph representation learning methods. Moreover, our edge representation learning and pooling method also largely outperforms state of the art graph pooling methods on graph classification, not only because of its accurate edge representation learning, but also due to its lossless compression of the nodes and removal of irrelevant edges for effective message passing.


A short proof of the chromatic Smith Fixed Point Theorem. We give a short and much simplified proof of the main theorem of the recent study, by T. Barthel, M. Hausmann, N. Naumann, T. Nikolaus, J. Noel, and N. Stapleton, of the Balmer spectrum for A equivariant stable homotopy when A is a finite abelian p group. This theorem says that if A is a finite abelian p group of rank r, and X is a finite A space that is acyclic in the (n r)th Morava K theory, then its space of fixed points, X A, will be acyclic in the nth Morava K theory. It is a chromatic homotopy version of P. A. Smith's classic theorem about the mod p homology of the fixed points of a finite A space.


Walking in the OEIS From Motzkin numbers to Fibonacci numbers. The "shadows" of Motzkin numbers. In this paper, we consider nine OEIS sequences, the analysis of which allows us to find a connection between Motzkin numbers and Fibonacci numbers. In each Motzkin number, we distinguish an even component and an odd component, the difference of these two components is called the shadow of the Motzkin number. Reverse of the Motzkin shadows give us a sequence from the family of Fibonacci numbers.


Riesz energy problems with external fields and related theory. In this paper, we investigate Riesz energy problems on unbounded conductors in R d in the presence of general external fields Q , not necessarily satisfying the growth condition Q(x) to infty as x to infty assumed in several previous studies. We provide sufficient conditions on Q for the existence of an equilibrium measure and the compactness of its support. Particular attention is paid to the case of the hyperplanar conductor R d , embedded in R d 1 , when the external field is created by the potential of a signed measure nu outside of R d . Simple cases where nu is a discrete measure are analyzed in detail. New theoretic results for Riesz potentials, in particular an extension of a classical theorem by de La Vall 'ee Poussin, are established. These results are of independent interest.


Data to text Generation with Macro Planning. Recent approaches to data to text generation have adopted the very successful encoder decoder architecture or variants thereof. These models generate text which is fluent (but often imprecise) and perform quite poorly at selecting appropriate content and ordering it coherently. To overcome some of these issues, we propose a neural model with a macro planning stage followed by a generation stage reminiscent of traditional methods which embrace separate modules for planning and surface realization. Macro plans represent high level organization of important content such as entities, events and their interactions they are learnt from data and given as input to the generator. Extensive experiments on two data to text benchmarks (RotoWire and MLB) show that our approach outperforms competitive baselines in terms of automatic and human evaluation.


Dataset and Performance Comparison of Deep Learning Architectures for Plum Detection and Robotic Harvesting. Many automated operations in agriculture, such as weeding and plant counting, require robust and accurate object detectors. Robotic fruit harvesting is one of these, and is an important technology to address the increasing labour shortages and uncertainty suffered by tree crop growers. An eye in hand sensing setup is commonly used in harvesting systems and provides benefits to sensing accuracy and flexibility. However, as the hand and camera move from viewing the entire trellis to picking a specific fruit, large changes in lighting, colour, obscuration and exposure occur. Object detection algorithms used in harvesting should be robust to these challenges, but few datasets for assessing this currently exist. In this work, two new datasets are gathered during day and night operation of an actual robotic plum harvesting system. A range of current generation deep learning object detectors are benchmarked against these. Additionally, two methods for fusing depth and image information are tested for their impact on detector performance. Significant differences between day and night accuracy of different detectors is found, transfer learning is identified as essential in all cases, and depth information fusion is assessed as only marginally effective. The dataset and benchmark models are made available online.


Inverse medium scattering problems with Kalman filter techniques II. Nonlinear case. In this paper, we study the inverse medium scattering problem to reconstruct unknown inhomogeneous medium from far field patterns of scattered waves. In the first part of our work, the linear inverse scattering problem was discussed, while in the second part, we deal with the nonlinear problem. The main idea is to apply the linear Kalman filter to the linearized problem. There are several ways to linearize, which introduce two reconstruction algorithms. Finally, we give numerical examples to demonstrate our proposed method.


Automatic Hand Sign Recognition Identify Unusuality through Latent Cognizance. Sign language is a main communication channel among hearing disability community. Automatic sign language transcription could facilitate better communication and understanding between hearing disability community and hearing majority. As a recent work in automatic sign language transcription has discussed, effectively handling or identifying a non sign posture is one of the key issues. A non sign posture is a posture unintended for sign reading and does not belong to any valid sign. A non sign posture may arise during sign transition or simply from an unaware posture. Confidence ratio has been proposed to mitigate the issue. Confidence ratio is simple to compute and readily available without extra training. However, confidence ratio is reported to only partially address the problem. In addition, confidence ratio formulation is susceptible to computational instability. This article proposes alternative formulations to confidence ratio, investigates an issue of non sign identification for Thai Finger Spelling recognition, explores potential solutions and has found a promising direction. Not only does this finding address the issue of non sign identification, it also provide some insight behind a well learned inference machine, revealing hidden meaning and new interpretation of the underlying mechanism. Our proposed methods are evaluated and shown to be effective for non sign detection.


Active Learning for Argument Strength Estimation. High quality arguments are an essential part of decision making. Automatically predicting the quality of an argument is a complex task that recently got much attention in argument mining. However, the annotation effort for this task is exceptionally high. Therefore, we test uncertainty based active learning (AL) methods on two popular argument strength data sets to estimate whether sample efficient learning can be enabled. Our extensive empirical evaluation shows that uncertainty based acquisition functions can not surpass the accuracy reached with the random acquisition on these data sets.


On the factorization invariants of the additive structure of exponential Puiseux semirings. Exponential Puiseux semirings are additive submonoids of qq geq 0 generated by almost all of the nonnegative powers of a positive rational number, and they are natural generalizations of rational cyclic semirings. In this paper, we investigate some of the factorization invariants of exponential Puiseux semirings and briefly explore the connections of these properties with semigroup theoretical invariants. Specifically, we prove that sets of lengths of atomic exponential Puiseux semirings are almost arithmetic progressions with a common bound, while unions of sets of lengths are arithmetic progressions. Additionally, we provide exact formulas to compute the catenary degrees of these monoids and show that minima and maxima of their sets of distances are always attained at Betti elements. We conclude by providing various characterizations of the atomic exponential Puiseux semirings with finite omega functions in particular, we completely describe them in terms of their presentations.


An undecidable extension of Morley's theorem on the number of countable models. We show that Morley's theorem on the number of countable models of a countable first order theory becomes an undecidable statement when extended to second order logic. More generally, we calculate the number of equivalence classes of sigma projective equivalence relations in several models of set theory. Our methods include random and Cohen forcing, Woodin cardinals and Inner Model Theory.


Pedagogical Rule Extraction to Learn Interpretable Models an Empirical Study. Machine learning models are ubiquitous. In some domains, for instance, in medicine, the models' predictions must be interpretable. Decision trees, classification rules, and subgroup discovery are three broad categories of supervised machine learning models presenting knowledge in the form of interpretable rules. The accuracy of these models learned from small datasets is usually low. Obtaining larger datasets is often hard to impossible. Pedagogical rule extraction methods could help to learn better rules from small data by augmenting a dataset employing statistical models and using it to learn a rule based model. However, existing evaluation of these methods is often inconclusive, and they were not compared so far. Our framework PRELIM unifies existing pedagogical rule extraction techniques. In the extensive experiments, we identified promising PRELIM configurations not studied before.


Spectral sets and tiles in mathbb Z p 2 times mathbb Z q 2 . In this paper we study Fuglede's conjecture on the direct product of two cyclic groups. After collecting the known results we prove that Fuglede's conjecture holds on mathbb Z pq times mathbb Z pq cong mathbb Z p 2 times mathbb Z q 2 .


BIGRoC Boosting Image Generation via a Robust Classifier. The interest of the machine learning community in image synthesis has grown significantly in recent years, with the introduction of a wide range of deep generative models and means for training them. In this work, we propose a general model agnostic technique for improving the image quality and the distribution fidelity of generated images, obtained by any generative model. Our method, termed BIGRoC (Boosting Image Generation via a Robust Classifier), is based on a post processing procedure via the guidance of a given robust classifier and without a need for additional training of the generative model. Given a synthesized image, we propose to update it through projected gradient steps over the robust classifier, in an attempt to refine its recognition. We demonstrate this post processing algorithm on various image synthesis methods and show a significant improvement of the generated images, both quantitatively and qualitatively, on CIFAR 10 and ImageNet. Specifically, BIGRoC improves the image synthesis state of the art on ImageNet 128x128 by 14.81 , attaining an FID score of 2.53 and on 256x256 by 7.87 , achieving an FID of 3.63.


Operation based Collaborative Data Sharing for Distributed Systems. Collaborative Data Sharing raises a fundamental issue in distributed systems. Several strategies have been proposed for making shared data consistent between peers in such a way that the shared part of their local data become equal. Most of the proposals rely on state based semantics. But this suffers from a lack of descriptiveness in conflict free features of synchronization required for flexible network connections. Recent applications tend to use non permanent connection with mobile devices or allow temporary breakaways from the system, for example. To settle ourselves in conflict free data sharing, we propose a novel scheme "Operation based Collaborative Data Sharing" that enables conflict free strategies for synchronization based on operational semantics.


MedSelect Selective Labeling for Medical Image Classification Combining Meta Learning with Deep Reinforcement Learning. We propose a selective learning method using meta learning and deep reinforcement learning for medical image interpretation in the setting of limited labeling resources. Our method, MedSelect, consists of a trainable deep learning selector that uses image embeddings obtained from contrastive pretraining for determining which images to label, and a non parametric selector that uses cosine similarity to classify unseen images. We demonstrate that MedSelect learns an effective selection strategy outperforming baseline selection strategies across seen and unseen medical conditions for chest X ray interpretation. We also perform an analysis of the selections performed by MedSelect comparing the distribution of latent embeddings and clinical features, and find significant differences compared to the strongest performing baseline. We believe that our method may be broadly applicable across medical imaging settings where labels are expensive to acquire.


The minimum linear locality of linear codes. Locally recoverable codes (LRCs) were proposed for the recovery of data in distributed and cloud storage systems about nine years ago. A lot of progress on the study of LRCs has been made by now. However, there is a lack of general theory on the minimum linear locality of linear codes. In addition, the minimum linear locality of many known families of linear codes is not studied in the literature. Motivated by these two facts, this paper develops some general theory about the minimum linear locality of linear codes, and investigates the minimum linear locality of a number of families of linear codes, such as q ary Hamming codes, q ary Simplex codes, generalized Reed Muller codes, ovoid codes, maximum arc codes, the extended hyperoval codes, and near MDS codes. Many classes of both distance optimal and dimension optimal LRCs are presented in this paper. The minimum linear locality of many families of linear codes are settled with the general theory developed in this paper.


3 parameter generalized quaternions. In this article, we give the most genaral form of the quaternions algebra depending on 3 parameters. We define 3 parameter generalized quaternions (3PGQs) and study on various properties and applications. Firstly we present the definiton, the multiplication table another properties of 3PGQs such as addition substraction, multiplication and multiplication by scalar operations, unit and inverse elements, conjugate and norm. We give matrix representation and Hamilton operators for 3PGQs. We get polar represenation, De Moivre's and Euler's formulas with the matrix representations for 3PGQs. Besides, we give relations among the powers of the matrices associated with 3PGQs. Finally, Lie group and Lie algebra are studied and their matrix representations are shown. Also the Lie multiplication and the killing bilinear form are given.


Singular plane sections and the conics in the Fermat quintic threefold. We present explicit equations for the space of conics in the Fermat quintic threefold X , working within the space of plane sections of X with two singular marked points. This space of two pointed singular plane sections has a birational morphism to the space of bitangent lines to the Fermat quintic threefold, which in its turn is birational to a 625 to 1 cover of PP 4. We illustrate the use of the resulting equations in identifying special cases of one dimensional families of conics in X.


Towards a more efficient approach for the satisfiability of two variable logic. We revisit the satisfiability problem for two variable logic, denoted by SAT(FO2), which is known to be NEXP complete. The upper bound is usually derived from its well known Exponential Size Model (ESM) property. Whether it can be determinized efficiently is still an open question. In this paper we present a different approach by reducing it to a novel graph theoretic problem that we call Conditional Independent Set (CIS). We show that CIS is NP complete and present two simple algorithms for it with run time O(1.4423 n) and O(1.6181 n), where n is the number of vertices in the graph. We also show that unless the "Strong Exponential Time Hypothesis" (SETH) fails, there is no algorithm for CIS with run time O(1.4141 n). We show that without the equality predicate SAT(FO2) is in fact equivalent to CIS in succinct representation. This yields two algorithms for SAT(FO2) without the equality predicate with run time O(1.4423 2 n ) and O(1.6181 2 n ), where n is the number of predicates. To the best of our knowledge, these are the first exact algorithms for an NEXP complete decidable logic with run time significantly lower than O(2 2 n ). We also identify a few lower complexity fragments of FO2 which correspond to the tractable fragments of CIS. Similar to CIS, unless SETH fails, there is no algorithm for SAT(FO2) with run time O(1.4141 2 n ). For the fragment with the equality predicate, we present a linear time many one reduction to the fragment without the equality predicate. The reduction yields equi satisfiable formulas with a small constant blow up in the number of predicates. Finally, we also perform some small experiments which show that our approach is indeed more promising than the existing method (based on the ESM property). The experiments also show that although theoretically it has the worse run time, the second algorithm in general performs better than the first one.


Multiple recurrence and large intersections for abelian group actions. The purpose of this paper is to study the phenomenon of large intersections in the framework of multiple recurrence for measure preserving actions of countable abelian groups. Among other things, we show (1) If G is a countable abelian group and varphi, psi G to G are homomorphisms such that varphi(G) , psi(G) , and ( psi varphi)(G) have finite index in G , then for every ergodic measure preserving system (X, mathcal B , mu, (T g) g in G ) , every set A in mathcal B , and every varepsilon 0 , the set g in G mu(A cap T varphi(g) 1 A cap T psi(g) 1 A) mu(A) 3 varepsilon is syndetic. (2) If G is a countable abelian group and r,s in mathbb Z are integers such that rG , sG , and (r pm s)G have finite index in G , then for every ergodic measure preserving system (X, mathcal B , mu, (T g) g in G ) , every set A in mathcal B , and every varepsilon 0 , the set g in G mu(A cap T rg 1 A cap T sg 1 A cap T (r s)g 1 A) mu(A) 4 varepsilon is syndetic. In particular, these extend and generalize results of Bergelson, Host, and Kra concerning mathbb Z actions and of Bergelson, Tao, and Ziegler concerning mathbb F p infty actions. Using an ergodic version of the Furstenberg correspondence principle, we obtain new combinatorial applications. We also discuss numerous examples shedding light on the necessity of the various hypotheses above. Our results lead to a number of interesting questions and conjectures, formulated in the introduction and at the end of the paper.


Weak species in rock paper scissors models. In this letter, we investigate the population dynamics in a May Leonard formulation of the rock paper scissors game in which one or two species, which we shall refer to as "weak", have a reduced predation or reproduction probability. We show that in a nonspatial model the stationary solution where all three species coexist is always unstable, while in a spatial stochastic model coexistence is possible for a wide parameter space. We find, that a reduced predation probability results in a significantly higher abundance of "weak" species, in models with either one or two "weak" species, as long as the simulation lattices are sufficiently large for coexistence to prevail. On the other hand, we show that a reduced reproduction probability has a smaller impact on the abundance of "weak" species, generally leading to a slight decrease of its population size the increase of the population size of one of the "weak" species being more than compensated by the reduction of the other, in the two species case. We further show that the species abundances in models where both predation and reproduction probabilities are simultaneously reduced may be accurately estimated from the results obtained considering only a reduction of either the predation or the reproduction probability.


SimpleX A Simple and Strong Baseline for Collaborative Filtering. Collaborative filtering (CF) is a widely studied research topic in recommender systems. The learning of a CF model generally depends on three major components, namely interaction encoder, loss function, and negative sampling. While many existing studies focus on the design of more powerful interaction encoders, the impacts of loss functions and negative sampling ratios have not yet been well explored. In this work, we show that the choice of loss function as well as negative sampling ratio is equivalently important. More specifically, we propose the cosine contrastive loss (CCL) and further incorporate it to a simple unified CF model, dubbed SimpleX. Extensive experiments have been conducted on 11 benchmark datasets and compared with 29 existing CF models in total. Surprisingly, the results show that, under our CCL loss and a large negative sampling ratio, SimpleX can surpass most sophisticated state of the art models by a large margin (e.g., max 48.5 improvement in NDCG 20 over LightGCN). We believe that SimpleX could not only serve as a simple strong baseline to foster future research on CF, but also shed light on the potential research direction towards improving loss function and negative sampling.


Multi Access Coded Caching with Secure Delivery. The multi access variant of the coded caching problem in the presence of an external wiretapper is investigated . A multi access coded caching scheme with K users, K caches and N files, where each user has access to L neighbouring caches in a cyclic wrap around manner, is proposed, which is secure against the wiretappers. Each transmission in the conventional insecure scheme will be now encrypted by a random key. The proposed scheme uses a novel technique for the key placement in the caches. It is also shown that the proposed secure multi access coded caching scheme is within a constant multiplicative factor from the information theoretic optimal rate for L geq frac K 2 and N geq 2K .


Dichotomy results for eventually always hitting time statistics and almost sure growth of extremes. Suppose (f, mathcal X , mu) is a measure preserving dynamical system and phi colon mathcal X to mathbb R a measurable function. Consider the maximum process M n max X 1 ldots,X n , where X i phi circ f i 1 is a time series of observations on the system. Suppose that (u n) is a non decreasing sequence of real numbers, such that mu(X 1 u n) to 0 . For certain dynamical systems, we obtain a zero one measure dichotomy for mu(M n leq u n , textrm i.o. ) depending on the sequence u n . Specific examples are piecewise expanding interval maps including the Gauss map. For the broader class of non uniformly hyperbolic dynamical systems, we make significant improvements on existing literature for characterising the sequences u n . Our results on the permitted sequences u n are commensurate with the optimal sequences (and series criteria) obtained by Klass (1985) for i.i.d. processes. Moreover, we also develop new series criteria on the permitted sequences in the case where the i.i.d. theory breaks down. Our analysis has strong connections to specific problems in eventual always hitting time statistics and extreme value theory.


Secure Watermark for Deep Neural Networks with Multi task Learning. Deep neural networks are playing an important role in many real life applications. After being trained with abundant data and computing resources, a deep neural network model providing service is endowed with economic value. An important prerequisite in commercializing and protecting deep neural networks is the reliable identification of their genuine author. To meet this goal, watermarking schemes that embed the author's identity information into the networks have been proposed. However, current schemes can hardly meet all the necessary requirements for securely proving the authorship and mostly focus on models for classification. To explicitly meet the formal definitions of the security requirements and increase the applicability of deep neural network watermarking schemes, we propose a new framework based on multi task learning. By treating the watermark embedding as an extra task, most of the security requirements are explicitly formulated and met with well designed regularizers, the rest is guaranteed by using components from cryptography. Moreover, a decentralized verification protocol is proposed to standardize the ownership verification. The experiment results show that the proposed scheme is flexible, secure, and robust, hence a promising candidate in deep learning model protection.


Learning Q function approximations for hybrid control problems. The main challenge in controlling hybrid systems arises from having to consider an exponential number of sequences of future modes to make good long term decisions. Model predictive control (MPC) computes a control action through a finite horizon optimisation problem. A key ingredient in this problem is a terminal cost, to account for the system's evolution beyond the chosen horizon. A good terminal cost can reduce the horizon length required for good control action and is often tuned empirically by observing performance. We build on the idea of using N step Q functions ( mathcal Q (N) ) in the MPC objective to avoid having to choose a terminal cost. We present a formulation incorporating the system dynamics and constraints to approximate the optimal mathcal Q (N) function and algorithms to train the approximation parameters through an exploration of the state space. We test the control policy derived from the trained approximations on two benchmark problems through simulations and observe that our algorithms are able to learn good mathcal Q (N) approximations for high dimensional hybrid systems based on a relatively small dataset. Finally, we compare our controller's performance against that of Hybrid MPC in terms of computation time and closed loop cost.


Non local dispersal equations with almost periodic dependence. II. Asymptotic dynamics of Fisher KPP equations. This series of two papers is devoted to the study of the principal spectral theory of nonlocal dispersal operators with almost periodic dependence and the study of the asymptotic dynamics of nonlinear nonlocal dispersal equations with almost periodic dependence. In the first part of the series, we investigated the principal spectral theory of nonlocal dispersal operators from two aspects top Lyapunov exponents and generalized principal eigenvalues. Among others, we provided various characterizations of the top Lyapunov exponents and generalized principal eigenvalues, established the relations between them, and studied the effect of time and space variations on them. In this second part of the series, we study the asymptotic dynamics of nonlinear nonlocal dispersal equations with almost periodic dependence applying the principal spectral theory developed in the first part. In particular, we study the existence, uniqueness, and stability of almost periodic solutions of Fisher KPP equations with nonlocal dispersal and almost periodic dependence. By the properties of the asymptotic dynamics of nonlocal dispersal Fisher KPP equations, we also establish a new property of the generalized principal eigenvalues of nonlocal dispersal operators in this second part of the series.


Reduced order models from computed states of physical systems using non local calculus on finite weighted graphs. Partial differential equation based numerical solution frameworks for initial and boundary value problems have attained a high degree of complexity. Applied to a wide range of physics with the ultimate goal of enabling engineering solutions, these approaches encompass a spectrum of spatiotemporal discretization techniques that leverage solver technology and high performance computing. While high fidelity solutions can be achieved using these approaches, they come at a high computational expense and complexity. Systems with billions of solution unknowns are now routine. The expense and complexity do not lend themselves to typical engineering design and decision making, which must instead rely on reduced order models. Here we present an approach to reduced order modelling that builds off of recent graph theoretic work for representation, exploration, and analysis on computed states of physical systems (Banerjee et al., Comp. Meth. App. Mech. Eng., 351, 501 530, 2019). We extend a non local calculus on finite weighted graphs to build such models by exploiting first order dynamics, polynomial expansions, and Taylor series. Some aspects of the non local calculus related to consistency of the models are explored. Details on the numerical implementations and the software library that has been developed for non local calculus on graphs are described. Finally, we present examples of applications to various quantities of interest in mechano chemical systems.


Probability monads as codensity monads. We show from a categorical point of view that probability measures on certain measurable or topological spaces arise canonically as the extension of probability distributions on countable sets. We do this by constructing probability monads as the codensity monads of functors that send a countable set to the space of probability distributions on that set. On (pre)measurable spaces we discuss monads of probability (pre)measures and their finitely additive analogues. We also give codensity constructions for monads of Radon measures on compact Hausdorff spaces and compact metric spaces and for the monad of Baire measures on Hausdorff spaces. A crucial role in these constructions is given by integral representation theorems, which we derive from a generalized Daniell Stone theorem.


OSRM CCTV Open source CCTV aware routing and navigation system for privacy, anonymity and safety (Preprint). For the last several decades, the increased, widespread, unwarranted, and unaccountable use of Closed Circuit TeleVision (CCTV) cameras globally has raised concerns about privacy risks. Additional recent features of many CCTV cameras, such as Internet of Things (IoT) connectivity and Artificial Intelligence (AI) based facial recognition, only increase concerns among privacy advocates. Therefore, on par emph CCTV aware solutions must exist that provide privacy, safety, and cybersecurity features. We argue that an important step forward is to develop solutions addressing privacy concerns via routing and navigation systems (e.g., OpenStreetMap, Google Maps) that provide both privacy and safety options for areas where cameras are known to be present. However, at present no routing and navigation system, whether online or offline, provide corresponding CCTV aware functionality. In this paper we introduce OSRM CCTV the first and only CCTV aware routing and navigation system designed and built for privacy, anonymity and safety applications. We validate and demonstrate the effectiveness and usability of the system on a handful of synthetic and real world examples. To help validate our work as well as to further encourage the development and wide adoption of the system, we release OSRM CCTV as open source.


Computing Coordinated Motion Plans for Robot Swarms The CG SHOP Challenge 2021. We give an overview of the 2021 Computational Geometry Challenge, which targeted the problem of optimally coordinating a set of robots by computing a family of collision free trajectories for a set set S of n pixel shaped objects from a given start configuration into a desired target configuration.


Generative Modeling with Optimal Transport Maps. With the discovery of Wasserstein GANs, Optimal Transport (OT) has become a powerful tool for large scale generative modeling tasks. In these tasks, OT cost is typically used as the loss for training GANs. In contrast to this approach, we show that the OT map itself can be used as a generative model, providing comparable performance. Previous analogous approaches consider OT maps as generative models only in the latent spaces due to their poor performance in the original high dimensional ambient space. In contrast, we apply OT maps directly in the ambient space, e.g., a space of high dimensional images. First, we derive a min max optimization algorithm to efficiently compute OT maps for the quadratic cost (Wasserstein 2 distance). Next, we extend the approach to the case when the input and output distributions are located in the spaces of different dimensions and derive error bounds for the computed OT map. We evaluate the algorithm on image generation and unpaired image restoration tasks. In particular, we consider denoising, colorization, and inpainting, where the optimality of the restoration map is a desired attribute, since the output (restored) image is expected to be close to the input (degraded) one.


Successive Cancellation Ordered Search Decoding of Modified G N Coset Codes. A tree search algorithm called successive cancellation ordered search (SCOS) is proposed for boldsymbol G N coset codes that implements maximum likelihood (ML) decoding by using an adaptive search schedule. The average complexity is close to that of successive cancellation (SC) decoding for practical frame error rates (FERs) when applied to polar and Reed Muller (RM) codes with block lengths up to 128. By modifying the algorithm to limit the worst case complexity, one obtains near ML performance for longer RM codes and their subcodes. Unlike other bit flip decoders, no outer code is needed to terminate decoding so SCOS also applies to modified boldsymbol G N coset codes with dynamic frozen bits. SCOS decoding is further extended by forcing it to look for candidates satisfying a threshold, thereby outperforming basic SCOS decoding under complexity constraints. Simulations with a (128,64) polarization adjusted convolutional code show gains in overall and undetected FER as compared to polar codes concatenated with an outer cyclic redundancy check code under SC list decoding at high signal to noise ratio over binary input additive white Gaussian noise channels.


Low Noise Microwaves for Testing Fundamental Physics. We studied noise properties of microwave signals transmitted through the cryogenic resonator. The experiments were performed with the 11.342 GHz sapphire loaded cavity resonator cooled to 6.2 K. Based on the measured transmission coefficient of the cryogenic resonator we computed its noise suppression function. This was done via Monte Carlo simulations some details of which are discussed in this Letter. Next, we measured technical fluctuations of a signal incident on the cryogenic resonator. Having processed these data with the previously computed noise filtering "template" we inferred noise spectra of the transmitted signal. We found that spectral densities of both phase and amplitude fluctuations of the transmitted signal were close to the thermal noise limit of 180 dB Hz at Fourier frequencies F ge 10 kHz. Such thermal noise limited microwaves allow more precise tests of special relativity and could be useful at some stages of quantum signal processing.